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The  indiviAufiL  p/io^e^AiurvoLi  papesiA  contained 
in  this  volume  were  prepared  for  presentation  to  the  Panel 
on  Cost  Effectiveness  Models  and  Evaluation  (Panel  7)  at 
the  Department  of  Defense  Logistics  Research  Conference 
held  at  the  Airlie  Conference  Center,  Warrenton,  Virginia, 
26-28  May  1965.  They  are  published  for  information  and 
background  in  relation  to  Panel  7  deliberations. 

Publication  of  these  individual  professional  papers 
by  the  Department  of  Defense  does  not  necessarily  signify 
that  they  represent  a  consensus  of  the  Panel  on  Cost  Effective¬ 
ness  Models  and  Evaluation  or  the  views  of  the  Office  of  the 
Secretary  of  Defense. 
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cost/effectiveness  analysis  within  the  army 


Oscar  M.  Wells 


The  primary  purpose  for  performing  cost/effectiveaess  studies, 
wherever  they  may  he  performed,  is  to  provide  a  sounder,  clearer, 
and  more  quantitative  basis  for  decision  n»-W-ing  ...  not  to  replace 
decision  malting  (l),  (8).  Of  course,  the  nature  of  the  decision 
called  for  is  determined  largely  by  the  organizational  level  for 
vhlch  the  C/E  study  is  performed.  Normally  the  decision  called  for 
is  a  choice  between  candidate  military  systems  for  acquisition,  (it 
is  conventional  to  call  these  candidates  "alternative  weapons  systems" 
although  there  may  be  several  options  and  although  these  may  not  in¬ 
volve  a  weapon  as  such.)  However,  some  studies  which  have  been  given 
the  name  c/e  have  only  dealt  with  the  question  of  economic  utilization 
of  operational  systems  (9) . 

Perhaps  some  would  quarrel  with  the  use  of  the  term  C/E  study  as 
applied  to  some  of  the  following  special  studies.  Their  comnon  element 
is  that  they  involve  an  examination  of  the  vaiue  obtained  through  the 
investment  of  a  set  of  resources.  We  submit  that  c/E  studies  are  per¬ 
formed  within  the  Army  for  purposes  as  small  as  helping  to  decide  between 
desigD  trade-offs  in  a  weapon  system,  and  as  comprehensive  as  helping  to 
decide  which  of  several  alternative  force  structures  to  acquire  and 
support. 

The  achievement  of  these  purposes  is  best  served  when  these  studies 
focus  early  on  the  hard  choices  to  be  made  between  competing  alternatives 
and  possibly  as  a  biproduct  of  such  analysis  suggest  other  alternatives  (2). 
The  function  of  the  analyst  is  to  present,  in  as  coneise  a  form  as  is 
possible,  the  costs  of  each  of  the  alternatives  and  the  expected  mili¬ 
tary  values  to  be  achieved  through  their  acquisition.  It  is  precisely 
the  expected  value  of  acquisition  that  should  rationally  be  compared 
with  cost  rather  than  the  potential  functional  capability.  Normally 
one  pays  increased  marginal  costs  for  increments  in  functional  capability. 
However,  if  the  tactical  significance  of  these  performance  increments  is 
great,  i.e.,  if  the  Increase  in  utility  is  great,  greater  investment  cost 
may  be  warranted.  This  point  has  not  always  been  clearly  understood. 

Although  a  great  deal  of  attention  has  been  given  to  C/E  studies 
of  strategic  retaliatory  and  strategic  airlift  and  sealift  systems,  a 
great  deal  of  concern  recently  has  been  with  tactical  ground  force 
systems  such  as  the  main  battle  tank  (4)  and  (5)  and  the  principal  Bmall 
arm  weapons  system  (3)  as  well  as  with  Army  tactical  air  support  of  ground 
forces  (7).  As  mentioned  by  Niskanen  (6)  analysis  of  such  systems  has 
been  more  difficult  in  many  respects  than  the  analysis  of  large  strategic 
systems  and  consequently  analytical  support  has  lagged. 
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Efforts  to  cone  to  grips  with  acme  of  the  conceptual  problems — to 
be  mentioned  later— have  been  made,  (5)  end  (6),  but  not  with  complete 
success;  and  much  needs  to  be  done  to  make  analysis  more  valid  and 
dependable. 

As  an  example  of  the  types  of  Army  C/E  studies  recently  reported 
in  a  special  bibliography  on  cost /effectiveness  by  the  Defense  Logistics 
Studies  Information  Exchange,  ve  can  make  the  following  observations.  We 
divided  the  20  titles,  felt  to  be  pertinent  to  C/E,  into  three  categories: 

(l)  materiel  or  case  studies,  (2)  studies  dealing  with  methodological  and 
philosophical  problems,  and  (3)  studies  performed  to  serve  as  guidance  in 

Performing  C/E  studies  or  in  serving  as  an  orientation  to  C/E.  Seven 
7)  titles  disalt  with  case  studies;  eight  (8)  primarily  with  methodology; 
and  five  (5)  served  as  educational  vehicles.  Of  the  eight  (8)  methodolo¬ 
gical  papers,  six  (6)  dealt  exclusively  with  costing. 

Bov  I  would  like  to  turn  to  the  consideration  of  three  classes  of 
problems:  first,  those  inherently  concerned  with  the  evaluation  of 
effectiveness;  second,  those  concerned  with  the  evaluation  of  costs; 
and  thirdly  those  problems  which  are  common  to  both  cost  and  effective¬ 
ness  evaluations.  I  shall  attempt  to  indicate  wherein  the  treatment  of 
these  problems  has  fallen  short  in  our  experience. 

It  is  clear  that  the  effectiveness  of  a  weapons  system  can  only  be 
evaluated  with  certainty  after  it  has  been  retired  from  operational  use. 

Even  then  these  would  only  be  subjective  and  mainly  qualitative  answers 
to  the  question  of  the  weapon's  effectiveness.  The  fact  is  that  there  is 
no  well  defined  quantitative  expression  for  effectiveness.  What  seems  to 
be  indicated  from  the  context  in  which  that  term  is  used  by  Hitch  (2)  end 
other  authorities  is  that  effectiveness  is  the  likely  value  that  the  system 
is  to  provide  or  contribute  to  the  total  defense  effort.  This  military  value 
stems  from  the  ability  of  the  system  to  successfully  perform  the  set  of  mili¬ 
tary  tasks  or  missions  assigned  it,  the  more  important  missions  being  given 
emphasis.  The  performance  of  these  military  tasks  is  obviously  related  to 
measures  of  function.  These  measures,  or  more  exactly.  Indices  of  functional 
capability  such  as  speed,  range,  payload,  etc.  are  often  themselves  called 
measures  of— or  components  of  effectiveness.  Although  the  application  of 
this  term  In  the  latter  manner  is  questionable,  it  1b  In  widespread  use  and 
Jill  be  so  used  here. 

Problems  arise,  however,  when  the  analyst  attempts  to  relate  such 
elementary  measures  to  less  well  defined  measures  such  as  vulnerability, 
flexibility,  maneuverability,  etc.  Problems  also  arise  when  one  seeks 
to  relate  all  the  components  of  effectiveness  end  to  evaluate  their 
relative  importance  in  the  accomplishment  of  the  set  of  military  missions. 
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To  summarize  the  problem*  Just  mentioned: 

(1)  to  define  the  eet  of  missions 

(2)  to  rank  these  missions  as  to  importance 

(3)  to  identify  and  quantify  the  components  of  effectiveness 

(4)  to  relate  these  to  each  other  and  to  the  level  of  mission 
accomplishment 

The  manner  in  vhlch  these  problems  Is  approached  varies  across  Army 
studies.  Missions  most  often  are  defined  by  direct  appeal  to  the  military 
user,  but  sometimes  on  the  basis  of  pertinent  historical  evidence.  In  the 
former  case  there  is  not  always  accord  from  authority  to  authority  and  one 
has  to  negotiate  or  appeal  to  the  decision  maker.  In  the  latter  case,  there 
is  a  great  risk  that  the  set  of  future  missions  for  a  system  will  differ 
from  the  past.  In  any  case,  it  is  much  easier  to  define  missions  than  to 
assign  them  relative  importance.  Since  the  result  of  this  act  is  so  depend¬ 
ent  upon  the  value  judgment  and  experience  of  the  individual,  one  only  has 
recourse  to  an  opinion  poll  of  authorltlative  users.  Often  this  latter  step 
is  simply  Ignored,  all  missions  being  treated  as  equally  important,  in  one 
case  (7),  or  only  the  principal  mission  considered,  in  the  other  case  (3). 

The  problem  of  identifying  and  quantifying  the  components  of  effective¬ 
ness  has  been  handled  primarily  by  an  appeal  to  the  judgment  of  the  analyst 
who  is  familiar  with  system  operation  and  the  set  of  missions.  His  skill 
and  insight  are  indispensable  here: 

If  all  of  the  forementloned  problems  have  been  attacked  competently, 
the  very  difficult  problem  remains  of  relating  the  components  of  effec¬ 
tiveness  to  each  other  and  to  the  level  of  mission  accomplishment. 

Several  ways  of  accomplishing  this  can  be  identified: 

(1)  the  user  opinion  poll 

(2)  a  combat  model  or  submodel 

(3)  a  combat  simulation  or  a  war  game 

(4)  a  field  exercise 

Each  method  has  its  advantages  and  disadvantages.  From  the  point -of 
vlev  of  being  quickly  responsive,  a  combat  model  had  distinct  advantages. 

It  also  provides  quantitative  outputs  that  can  be  verified  by  well  designed 
field  experiments.  The  latter  aspect  is  important  and  is  not  provided  by 
method  (l). 

The  use  of  any  of  tbe  four  methods  brings  up  explicitly  or  illicitly 
the  question  of  how  ve  stand  competitively  in  the  accomplishment  of  the 
missions  for  which  these  systems  were  designed*  Because  of  the  difficulty 
in  obtaining  adquate  intelligence,  this  is  an  area  of  considerable  un¬ 
certainty. 
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There  is  a  continuing  problem  in  most  C/E  studies  not  merely  to 
acquire  Intelligence  concerning  the  enemy’s  current  materiel  resources 
hut  to  predict  what  they  will  be  when  our  prototypes  are  operational. 
Unfortunately  many  Army  C/E  studies  have  not  adequately  dealt  with  this 
problem.  The  way  in  which  various  possible  future  threats  may  influence 
a  decision  to  acquire  a  military  system  is  not  always  clear-cut.  For 
example,  if  a  reasonable  contingency  is  that  the  nature  of  the  threat  will 
change  so  as  to  remove  a  substantial  number  of  the  missions  for  which  the 
system  (s)  were  designed,  the  decision  maker  may  wish  to  defer  making  a 
decision  pending  introduction  of  other  alternatives  or  he  may  decide  to 
go  with  one  of  the  current  alternatives,  talcing  the  risk  that  system  life 
will  be  drastically  shortened.  In  the  area  of  strategic  air  defense 
systems  such  a  decision-making  environment  was  brought  about  by  the 
enemy's  shift  from  manned  bombers  to  ballistic  missiles.  Therefore,  it 
is  important  to  explicitly  ask  the  question  of  whether  the  mlssion(s) 
for  which  the  system  was  designed  are  likely  to  persist  throughout  a 
reasonable,  useful  life  of  the  system. 

Turning  to  the  area  of  costing,  ve  encounter  equally  vexing  problems. 
It  is  generally  conceded  to  be  desirable  to  approach  cost/affectiveness  by 
pivoting  on  cost,  i.e.,  by  scaling  each  of  the  alternatives  to  the  same 
total  expected  cost.  The  principal  advantage  of  doing  this  is  to  avoid 
the  necessity  of  defining  military  worth  in  absolute  terms.  Also  elements 
which  are  difficult  to  quantify  may  he  left  in  qualitative  terms.  It  is 
easier  to  merely  rank  the  effectiveness  of  alternatives  than  to  evaluate 
them* 


There  are  two  problems  relative  to  implementing  a  cost  pivot  which 
are  serious.  The  first  is  concerned  with  the  question  of  scaling  unequal 
alternatives  to  the  same  expected  cost.  And,  the  second  is  concerning  with 
explicitly  displaying  the  variability  associated  with  making  estimates  of 
future  costs.  Obviously,  alternatives  are  really  constant  as  to  cost  only 
when  they  have  nearly  the  same  distribution  of  expected  costs.  In  the 
event  these  distributions  are  not  the  same,  the  analyst  can  alter  numbers 
of  units,  numbers  of  supporting  personnel,  size  of  mobilization  base, 
configurational  aspects  of  hardware,  etc.,  within  limitB,  so  as  to  make 
expected  costs  constant  over  alternatives.  After  doing  this,  he  may  still 
see  considerable  differences  in  cost  variability  among  alternatives.  The 
analyst  oust  decide  whether  the  costs  can  be  meaningfully  scaled  and 
whether  differences  in  cost  variability  invalidate  this  procedure.  One 
weakness  of  Army  C/E  studies  to  date  has  been  the  failure  to  deal  sensibly 
with  the  latter  problems. 

Among  analysts  within  the  Army, there  has  been  some  confusion  as  to 
the  treatment  of  inherited  assets.  For  example,  that  peat  of  the  cost 
of  training  for  a  system  in  use  that  is  applicable  to  Its  replacement 
should  be  considered  an  inherited  asset  and  only  the  incremental  train¬ 
ing  costs  imputed  to  the  replacement. 
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Not  all  c/E  studies  within  the  A rmy  have  considered  the  time  phasing 
of  costs,  which  may  differ  among  alternatives  and  have  an  important  Influ¬ 
ence  In  decision  making.  An  early  study  by  RAC  (4)  on  cur  tank  program 
did  an  excellent  job  in  presenting  the  cost  versus  time  consequences  for 
each  alternative,  breaking  out  developmental,  investment,  and  O&M  costs. 

There  is  a  continuing  need  for  such  a  thoroughgoing  approach.  Associated 
with  differing  prospective  expenditures  over  time  is  the  need  to  use  dis¬ 
counting  and  the  need  to  observe  budgetary  constraints.  We  feel  that 
questions  bearing  on  these  issues  should  be  settled  early  in  the  analysis 
in  concert  with  decision  and  policy  caking.  Arbitrary  discount  rates  are 
unwarranted. 

For  high-level  c/E  studies,  system  life—  on  the  basis  of  which 
costing  is  performed —  is  considered  to  be  5  or  7  years.  This  is  probably 
realistic  for  some  systems,  but  may  under-rate  others  badly.  In  the  area 
of  weapons,  we  feel  that  alternative,  competitive  systems  should  be 
assigned  different  lives  if  that  seems  warranted.  Alternatives  can  then  be 
compared  on  the  basis  of  average  cost  per  year  of  operation. 

For  many  "conventional "  Army  systems  the  end  of  life  value— whether 
value  on  the  civilian  market  or  as  an  asset  to  a  new  system- -may  not  be 
negligible  and  should  be  considered  in  costing  kray  systems.  Unfortunately, 
this  has  not  always  been  done. 

There  are  many  problems  that  are  common  to  the  evaluation  of  both 
system  cost  and  system  effectiveness.  Briefly  some  of  these  sure: 

a.  quections  of  commensurability  in  the  treatment  of  components  of 
cost  and  components  of  effectiveness. 

b.  questions  pertaining  to  the  uncertain  utilization  of  the  system 
such  as 

1.  extent  of  wartime  use 

2.  nature  of  conflict 

3.  mobilization 

c.  questions  pertaining  tc  the  rate  of  obsolescence  of  the  competing 
alternatives 

d.  treatment  of  uncertainties  in  development,  manufacture,  and 
malntenanc e . 

These  conmon  problems  pose  some  of  the  greatest  difficulties  in 
structuring  end  conducting  C/E. 

We  mentioned  earlier  that  comnensurabixity  was  achieved  among  effec¬ 
tiveness  components  by  attempting  to  weight  the  components  by  factors  derived 
from  tactical  military  experience.  In  view  of  the  changing  nature  of  war 
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an d  the  subjective  nature  of  human  experience,  ve  are  quite  skeptical 
of  the  validity  of  this  procedure  and  do  not  recosnend  it.  In  fact,  if 
coonensurablllty  were  only  achievable  by  this  means,  ve  feel  It  Is  pre¬ 
ferable  to  present  the  components  effectiveness  to  the  decision  maker 
separately.  His  will  then  be  the  responsibility  of  attaching  value  to 
each.  Also  there  are  Instances  where  differing  resources  such  as  oper¬ 
ating  personnel  and  plant  should  not  simply  be  assigned  a  dollar  value 
and  aggregated  for  each  of  the  alternatives,  particularly  if  they 
differ  markedly  in  emphasis  among  alternatives .  Obviously  a  compromise 
must  be  made  between  complexity  or  detail  and  aggregation.  It  is  of  value 
to  present  the  decision  maker  with  a  simple  picture,  omitting  detail  where 
this  can  be  done;  however,  when  a  multidimensional  concept  such  as  effective¬ 
ness  is  given  a  single  number  in  the  interests  of  simplicity,  meaning  Is 
lost. 


Clearly,  in  the  absence  of  any  deterrence  effect,  a  military  system 
has  value  only  when  it  is  used  tactically.  (Systems  with  no  prospective 
tactical  use  are  not  funded  regardless  of  their  potential  combat  effec¬ 
tiveness.)  If  it  is  true  that  the  amount  one  1b  willing  to  pay  for  a 
military  system  Is  related  to  the  expected  military  benefits  or  value, 
then  it  follows  that  the  decision  to  acquire  a  system  is  based  upon 
rational  estimates  of  future  tactical  use.  For  costing  purposes  as  well, 
it  Is  necessary  to  make  an  assumption  about  the  extent  of  future  conflict, 
since  generally  wartime  and  peacetime  costs  of  system  operation  are  not 
the  same.  Therefore,  any  c/e  study  must  come  to  grips  with  the  nature 
and  extent  of  future  conflict.  Few  Army  studies  have! 

Perhaps  because  of  the  pressure  to  complete  a  C/E  study,  not  enough 
use  has  been  made  of  parametric  and  contingency  analyses  within  the  Army. 
These  are  methods  which  ve  feel  are  useful  in  approaching  the  uncertainties 
in  development,  manufacture,  operation,  and  maintenance  faced  in  both 
cost  and  effectiveness  analyses. 
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Herbert  J.  Liebermmn 

Bureau  of  Supplies  and  Accounts 

COST  EFFECTIVENESS  PROJECTS  IN  THE  DEPARTMENT  OF  THE  NAVY 

The  Navy,  Ilk#  her  sister  services,  recognises  the  value  and,  in  fact, 
the  necessity  of  examining  the  economic  as  well  as  the  operational  conse¬ 
quences  of  choosing  between  competing  programs.  The  demand  continues  for 
a  high  degree  of  availability  in  weapon  systems  and  suDporting  resources. 

This  requirement  coupled  with  budgetary  restrictions  orovides  the  impetus 
for  utilising  such  techniques  as  cost/effectiveness  analyses.  Although  in 
their  early  developmental  stage,  these  will  be  undoubtedly  only  the  first 
generation  of  such  evaluative  methods  at  the  disposal  of  the  decision-maker. 

With  this  thought  in  mind,  we  will  review  some  of  the  specific  work  on 
effectiveness  today  in  ths  Navy.  Before  proceeding  further,  it  iB  well 
to  mention  that  the  studies  and  models  cited  here  are  but  a  few  of  those 
currently  underway  in  the  Navy  today.  In  addition,  the  scope  of  this 
paper  ie  not  limited  to  only  that  work  which  treats  of  cost/effectiveness 
in  a  strict  sense  of  the  words,  but  includes  as  well  those  studies,  projects 
or  tasks  which  concern  themselves  in  some  way  with  evaluating  performance 
together  with  its  attendant  costs.  Other  terms  such  as  "readiness," 

"systems  effectiveness,"  and  "logistics  rapport  performance"  were 
uncovered  in  the  course  of  this  survey  and  are  often  used  interchangeably 
in  the  decision  process  aimed  at  answering  such  questions  as: 

1.  Which  of  several  competing  weapons  systems  should  be  developed 
with  available  resources? 

2.  What  should  the  logistics  support  policy  for  a  ship  or  a  system 
be  to  provide  the  maximum  material  readiness? 

3.  What  are  the  consequences  in  terms  of  performance  of  a  budget 
reduction? 
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The  thread  of  cormonallty  that  la  woven  through  each  of  the  following 
studies  is  the  project’s  concern  with  the  ability  to  measure  a  system's 
performance  or  effectiveness  in  accomplishing  its  designed  function  and 
to  relate  this  performance  to  some  expenditure  of  resources. 

The  following  is  a  list  of  projects: 

Cost  Effectiveness  Projects  in  the  Navy 
.  14  Classified  CMC  Projects 

.  Generalised  C/JS  Models 
.  FLSIP 
.  MjSTRI 

.  IMI  Project  6  P  (>WASO) 

A  number  of  studies  on  which  cost  effectiveness  analysis  is  being 
carried  out  are  of  a  classified  nature.  The  extent  to  which  they  can  be 
discussed  is  limited  to  an  identification  of  their  titles.  These  are 
shown  here  merely  to  identify  the  general  areas  of  operation  and  scenario 
situations  which  prompt  the  need  for  cost  effectiveness  evaluations.  Most 
of  these,  as  you  can  see,  have  logistic  support  connotations. 

Chief  iaf  Naval  Operations  Projects 

1.  Strategic  Implications  of  Overseas  Bases  and  Island  Possessions. 

2.  Nuclear  Power  for  Surface  Warships  Endurance. 

3.  U.  S.  Merchant  Marine  Shipping  Levels, 

4.  ASW  Force  Levels  (Cyclops  II). 

5.  Non-Nuclear  Ordnance  (Combat  Consumables). 

6.  Sea-Based  Logistic  Support 
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7.  Role  of  Nuclear  Of fens ire  end  Defensive  Forces  (1970  -  1980). 

8.  Receive  Fleet  Evaluation. 

9.  Logistic  Support  of  a  Land  Campaign. 

10.  Control  of  the  Sea  (Cyclops  III). 

11.  Petroleum,  Oil  and  Lubricants  Studies 

12.  Communications,  Command  and  Control. 

13.  Amphibious  Warfare. 

14.  Logistic  Support  of  Navy  Combatant  Forces 

C/d  figatllUllfl  Httiftlfl 

The  Navy  is  becoming  more  and  more  oriented  to  the  process  of  thinking 
and  decision  making  which  embodies  the  principles  of  systems  effectiveness 
and  cost  evaluation.  System  effectiveness  which  is  becoming  a  popular  topic 
in  the  of floes  of  the  Chief  of  Naval  Material  ia  defined  ae  "the  capability 
of  a  system  to  operate  successfully  when  required  under  specified  conditions 
or  environment. n  The  basic  equation  representing  system  effectiveness  is 
the  E  =  PAU,  where  £_  is  system  effectiveness,  "P”,  the  system’s  jjer- 
formence;  "A",  the  availability  or  the  fraction  of  time  the  system  is 
ready  to  function;  and  "U",  the  utilization  or  fraction  of  the  performance 
capability  actually  utilised  for  a  specific  application  in  a  specified 
environment M 

The  term  P  -  Pfyfrwmmf^e  is  a  numerical  index  expressing  the  system's 
functional  ability  assuming  a  hypothetical  100jS  availability,  reliability, 
and  utilisation  of  performance  capability  in  actual  operation.  This  index 
can  be  expressed  in  any  suitable  terms  dependent  upon  the  nature  of  the 
mission.  For  instance,  in  a  satellite  system  it  could  b*  in  rated  pounds  of 

1/  Systems  Effectiveness  Presentations,  compiled  by  the  Systems  Effectiveness 
Branch  of  the  Office  of  Naval  Material,  January  196$. 
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payload  into  orbit  per  successful  vehicle.  In  a  tissile  system  it  could 
represent  target  ao  lire  miles  "killed"  per  successful  launch.  In  effect, 
it  is  the  mission  determinant  oarameter. 

The  term  U  -  Utilization  is  the  fraction  of  the  performance  capability 
actually  utilized  due  to  the  specific  application  and  the  environment 
encountered.  In  effect  it  expresses  all  of  the  effectiveness  degradation 
due  to  causes  external  to  the  system  itself.  This  term  ie  largely  out  of 
the  control  of  the  designer  and  one  which  in  the  final  analysis  can  only  be 
established  ex  post  facto.  Nevertheless,  it  is  a  function  which  can  vary 
as  a  result  of  inherent  design  limitations.  Such  factors  as  consideration 
of  operational,  physical,  and  in  sane  cases  political  environment  factors 
operates  on  this  function. 

The  central  factor  "_4"  is  the  period,  or  fraction  of  time,  that  the 
system  is  ready  and  capable  of  fully  performing  its  mission.  Conventionally 
"A"  is  expressed  as: 

a - MI BE _ 

~  MTBF+MTTR 

where  MTBF  is  the  mean- time-be tween-failures. 

MTTR  is  the  mean-time-to-repair . 

Of  course,  in  obtaining  systems  effectiveness,  we  must  pay  out  or  incur 
a  cost.  When  we  insert  the  element  of  cost,  we  add  another  dimension  to 
our  evaluation.  The  form  of  the  expression  now  becomes,  Ec  -  — —  where, 

ca  Cu 

r2c  is  the  cost  effectiveness  of  the  system  in  question,  where  Ca  is  the  cost 
of  acquisition  and  Cu,  the  cost  of  utilization.  The  cost  of  acquisition  (Ca) 
is  the  total  dollar  cost  of  development  and  production,  while  the  cost  of 
utilization  is  the  average  annual  dollar  cost  of  operating  and  maintaining 


the  system,  including  the  extern*!  cost  of  its  failures  multiplied  by  the 


number  of  years  of  useful  life.  The  following  is  a  list  of  all  of  the  cost 
factors  which  comprise  the  two  cost  terms  in  the  denominator  of  the  3/ci 
equation. 

Ca  (Cost  of  Acquisition)  Cu  (Cost  of  Utilization) 


(Ops  Analysis 
(System  Definition 
Development  (System  Design 

(Hardware  Design 
(Test  Evaluation 


(Procurement 

(Manufacture 

Production  (Installation 

(Test 
(Training 


In  the  past  we  have  had  a  tendency 


(Personnel 
Operations  (Facilities 
(Utilities 
(Special  Inputs 

+ 

(Personnel 
(Facilities 
Maintenance  (Spares 

(Logistics 
(Diagonistic  Aids 

+ 

External  Cost  Due  to  Failures 
to  look  only  at  the  costs  of  procuring 


or  acquiring  a  system  in  deciding  on  a  major  development  and  eventual  pro¬ 
curement  action.  However,  the  cost  of  utilisation  is,  at  least,  as  important. 
We  can  no  longer  afford  to  out  a  system  into  the  hands  of  our  operating  forces 


which  is  too  costly  to  operate  and  maintain. 

Another  addition  to  the  Eq  equation  that  has  been  proposed  is  the 
inclusion  of  a  military  worth,  parameter  W.  With  it,  the  new  expression  for 


Ee  reads: 


CL 


C 


=  W 


—ML 

Ca  +  Cu 


W  is  defined  as: 


W  =  f 2W2  +• ; *f  nV 

a 


790- >91  0-01-2 
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where  f  la  tha  fraction  of  tha  a/a tan  affort  devoted  to  &  given  ml talon 
alanant  w,  and  tha  f^  *  1 


An  additional  consideration  that  could  ba  lneorporatad  would  ba  tha  degrading 
of  military  worth  over  time  -  thia  degrading  of  w  over  time  would  oauae  tha 
Ee  expression  or  as  it  night  now  ba  called,  £4  (Defense  Effectiveness)  to 
look  llket 


,  „  J i  L-EA1LJ 

*  *t,  (c»  +  Cu) 


W  and  in  thia  aquation  are  both  pure  judgment  factors  and  would  require 
gaming  or  similar  type  of  simulation  to  provide  an  insight  into  this  value 
to  the  analysis. 

One  point  to  bear  in  mind  regarding  the  C/E  expression  is  that  tha  value 
of  C/E  is  an  index.  As  described  hare  it  is  useful,  then,  as  a  relative 
measure  or  naans  of  cornering  comoeting  candidates  for  nrocurenent. 

One  of  tha  difficulties  encountered  in  using  this  as  well  as  most  of 
the  other  cost  models  is  the  availability  of  sufficiently  reliable  and 
reoresentatlve  cost  data.  Another  difficulty  is  relating  properly  cost 
factors  which  are  not  of  a  conmeasurable  nature.  As  a  gross  means  of 
looking  at  two  separate  systems,  this  type  of  model  would  appear  satisfactory, 
howaver,  in  any  particular  case,  an  error  in  ona  of  the  cost  parameters 
could  lead  to  an  Incorrect  choice.  We  have  a  long  way  to  go  in  refining 
the  systems  which  currently  provide  us  with  cost  information.  Another  point 

e 

to  make  here  is  that  we  are  accustomed  to  thinking  of  cost  as  being  dollars. 
Hcwever,  dollars  are  only  the  medium  of  exchange.  The  resource#  money 
represents  are!  manpower,  material,  facilities,  and  time.  We  must,  therefore, 
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choose  between  these  In  determining  which  resources  to  expend  in  gaining 
system  effectiveness.  Therefore,  cost  effectiveness  is  really  a  measure 
of  how  well  we  spend  these  resources  in  obtaining  our  objective. 

FL3IP 

The  Fleet  Logistics  Support  Improvement  Program  (FLSIP)  was  initiated 
by  the  Chief  of  Naval  Operations  under  an  Oi'NAV  Instruction  4441.12  of 
27  August  1964  to  set  forth  basic  Navy  policy  governing  the  determination 
of  fleet  material  requirements,  fleet  asset  distribution,  and  for  prescribing 
the  shipboard  endurance  necessary  to  achisve  the  dssired  standards  of 
lcgistic  readiness  and  endurance.  Basically,  the  objective  is  to  determine 
the  range  and  depth  of  repair  part  acd  equipment  -  related  consumables 
necessary  to  provide  Individual  ships  with  90  days  basic  combat  endurance. 

The  Bureau  of  Supplies  and  Accounts,  together  with  the  Bureau  of  Ships  and 
Bursai  of  Naval  Weapons,  is  developing  explicit  rules  for  determining  which 
candidates  are  to  be  selected  for  stocking  aboard  combatant  hulls.  The 
procedure  bei.’a’  set  forth  is  to  divide  candidates  for  stocking  into  demand 
based  or  Into  insurance  categories.  For  items  in  ths  insurance  category, 
questions  are  asked  concerning  their  vital  or  non-vital  effect  on  parent 
assemblies.  This  rough  determination  of  essentiality  has  ths  tendency  to 
lower  the  range  of  items  carried  for  insurance  protection.  As  a  consequence, 
there  can  be  significant  reductions  in  shipboard  allovancs  list  investment. 

The  specific  rules  to  be  used  are  stated  as  follows: 

For  the  thousands  of  parts  that  are  candidates  for  a  shipboard  allowance 
list,  the  maintenance  code  is  used  as  the  range  selector.  That  is,  an  item 
or  part  is  not  considered  for  stocking  unless  the  maintenance  code  indicate* 
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i  shipboard  repair  capability.  After  passing  the  candidacy  teat,  the  ship- 
boiird  population  of  the  item  and  its  exoected  replacement  rate  ie  used  to 
categorise  it  aa  a  demand  baaed  item  or  as  an  insurance  item.  If  the 
product  of  shipboard  copulation  times  the  expected  quarterly  (90  days) 
replacement  rate  is  1,  the  item  is  classed  as  demand  based  and  is 
stocked  at  a  90%  protection  level  for  90  days.  If  the  product  is  -C  1,  it 
is  classed  as  an  insurance  item  and  a  saries  of  two  questions  concerning  its 
vital/non- vital  nature  are  posed.  The  first  asks  whather  the  component  to 
which  the  particular  item  belongs  (part)  is  vital  or  not  to  the  performance 
of  the  ships  mission,  and,  secondly,  whether  the  part  itself  is  vital  to  the 
performance  of  its  parent  component.  The  ipsurance  items  which  carry  the 
following  vital  (  V  )  /  non-vital  (  NV  )  designation  are  excluded  from  the 
allowance  list. 

farfr-ta-tamanant  - -  component-  to-huii 

1.  v  _ _ m 

2.  N V  _ _  V 

3.  NV  _  NV 

In  other  words,  if  an  item  is  given  a  vital/vital  (W)  code,  it  is  stocked 
(under  the  additional  condition  that  there  has  been  at  least  one  demand  for 
it  somewhere  in  the  Navy  system  over  the  past  2  years). 

There  relatively  basic  rules  have  been  tested  on  several  ships  and 
will  be  implemented  fleet-wide  in  the  near  future.  Current  expectations  are 
that  tho  us*  of  these  stocking  criteria  will  reduce  the  shipboard  range  of 
line  items  by  about  25%  with  a  similar  reduction  in  dollar  investment.  The 


use  of  these  rules  represents  the  first  extensive  application  of  historical 
usage  data  (£DR?)^  and  military  essentiality  considerations  in  allowance 
list  decisions. 

The  one  area  which  might  be  cited  as  a  shortcoming  in  this  technique  is 
the  exclusion  of  explicit  cost  parameters  in  the  stocking  criteria.  A 
technique  which  does  incorporate  the  price  of  repair  parts  in  its  allowance 
determination  is  a  project  on  the  horizon,  entitled  M2TRI,  which  is  currently 
in  the  research  and  development  phase. 

MffTRI 

The  Military  Essentiality  Through  Readiness  Indices  (K2TRT)  project 
under  the  direction  of  the  Bureau  of  Supplies  and  Accounts  (BUSANDA)  has 
as  its  objective  the  development  of  a  technique  for  determining  shipboard 
allowance  list  stocks.  Unlike  FLSIP,  which  will  soon  be  utilised  throughout 
the  fleet,  METRI  is  still  undergoing  research  and  development.  As  currently 
formulated,  METRI  involves  the  development  of  an  engineering  model  that 
functionally  describes  the  operation  of  a  force  unit  such  as  a  ship.  The 
model  is  a  series  of  charts  that  shows  how  each  item  in  the  force  unit 
contributes  to  its  overall  mission,  ifhen  the  model  is  completed,  it  is 
converted  into  a  set  of  equations  which  are  then  computer  programmed  and  used 
to  simulate  the  effect  of  failures  of  parts  installed  aboard  ship.  In  this 
way,  the  effect  of  each  Individual  item  in  the  force  unit  can  be  traced  in  a 
system-wise  fashion.  The  simulated  model  reproduces  in  a  short  oeriod  of  time 
experience  that  would  take  many  years  of  conventional  operation  to  obtain. 

1/  L,  Mini  lough.  AIR  AND  REPORT  39, 

Experienced  Demand  Replacement  Factors  (EDRF), 

U.  S.  Navy  Ships  Parts  Control  Center, 

25  January  1963 
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Thft  nodal  combine*  military  judgment  with  engineering  data  to  represent  the 
functional  interrelationships  of  parts- to-components,  eomponents-to-equioosnt,. 
equipment- to-system,  etc.  aboard  a  shio  and  to  integrate  the  decisions  on 
what  iteas  to  support  rather  than  treating  each  type  of  part  Individually  on 
an  i tea- to- i tea  basis  as  is  currently  done. 

The  ship  is  modeled  by  using  the  four  following  relationships : 


Rt  =  Met  system  readiness 

ft2,  ...  Rjj  —  Individual  readiness  of  each  of  the  supplementary  elements 

Kj,  K2,  ...  Kjj  =  The  relative  importance  or  contribution  of  each  element 

where:  jfc  K.  *  1 

i=l  1 

A  »  A  constant  indicating  bow  the  system  readiness  is  affected  by  element 
readiness 


R-p  -  Net  system  readiness 

Rj,  Rj*  ...  Rfl  *  Individual  readiness  of  each  of  the  series  elements 
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Alternate : 


Rj  =  Net  system  readiness 

=  Readiness  of  the  primary  system 
Rj  =  Readiness  of  the  alternate  system 

K  =  Contribution  of  the  alternate  system  when  acting  in  place  of 
the  nrimary  system 


Collateral 


RT  =  RX  £  ♦  (1-K)  R^ 


Rt  =  Net  system  readiness 

=  Readiness  of  the  essential  element 
Rg  5  Readiness  of  the  desirable,  but  not  essential,  element 
K  -  Percentage  of  the  rated  performance  that  can  be  expected  if  the 
system  must  operate  using  only  the  essential  element 
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The  following  equation  ie  used  with  the  model  structure  of  the  ship  to 
determine  the  AR  or: 


where:  m  -  number  of  applications  aboard  shio  of  the  i4^  part, 

n  =  number  of  spares  for  all  m  applications  of  the  part. 

X~  failure  rate  of  part. 

"change  in  material  readinese"  that  results  from  adding  additional  units 

of  a  repair  part.  By  tracing  the  oath  from  the  part  level  to  mission  level 

of  the  ship,  a  AR  can  be  determined  for  each  part.  The  is  computed 

for  each  item  where  AP  is  the  unit  price.  The  are  sequenced  in 

Ar1  S 

descending  order  and  the  list  is  truncated  at  any  desired  investment  level. 

The  range  and  depth  of  items  so  determined  constitute  the  allowance  quantities 
for  the  particular  investment  level.  By  computing  a  number  of  such  lists,  a 
readiness  vs.  cost  curve  can  be  constructed. 

Current  work  in  developing  a  technique  for  deriving  consistent  and 
operationally  meaningful  judgment  factors  for  the  modal  is  being  carried 
out.  The  computational  approach  is  under  revision  to  provide  for  a 
technically  sound  and  operationally  feasible  tool  for  allowance  list 
decisions.  One  of  the  problems  confronting  this  as  well  as  other  projects 
requiring  comprehensive  and  accurate  input  data  is  the  lack  of  such  information. 
The  Navy's  3M  Program  (Standard  Navy  Maintenance  and  Material  Management 
Program  (3NMMMP))  shows  promise  of  generating  useful  failure  rate  information 
several  years  from  now,  „ 
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Returning  to  more  standard  type  cost  effectiveness  approaches,  the 
Weapons  Systems  analysis  Office  (VS AO)  of  the  Bureau  of  ’Javal  Weapons 
collaborated  with  the  Logistics  Management  Institute  (L*!I)  during  the 
litter's  development  of  imoroved  methods  for  evaluating  alternative  logistic 
support  programs  for  major  weapon  systems.  The  purpose  of  WSAO  oirticipation 
was  to  assist  the  F-4  Project  Manager  in  providing  the  innut  data  required 
by  IMI  for  this  task  and  to  pursue  jointly  with  IMI  the  develorment 
objectives  of  the  task. 

The  means  for  making  the  comparative  evaluations  of  alternative  support 
programs  are  provided  through  the  use  of  a  "ratio"  factor  (R)  and  a 
"trade-off"  factor  (T).  The  "ratio"  factor  R  was  developed  primarily 
for  use  at  03D  and  Military  Department  levels  and  is  a  measure  of  a  Support 
Program's  affect iveness.  The  expression  for  this  resembles  the  generalized 
models  described  earlier. 

P  =  U..+  KP _ 

R  C.  +  C-  m 

A  s  o 

where:  R  -  Support  Programs  effectiveness  for  a  given  Weapon  System 

U  -  Up  Weapon  System  Hours;  a  function  of  total  program  cost 

D  -  Down  Weapon  System  Hours 

C ,=  Cost  of  Acquisition 

C8-  Support  Cost  (personnel,  technical  data,  etc.) 

CQ=  Cost  of  Ooerator 

k  -  A  constant  modifying  down-time  hours 
The  R  factor  can  be  used  to  calculate  the  best  C/s  quantity  of  an 
individual  support  element  where  the  relationship  between  up-time  and  the 
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cost  of  the  element  is  known.  The  k—  support  item  quantity  Is  determined 
by*  Uf  (Nk) 

R*  =  ux  +  Vk 

where:  =  c/g  ratio  for  determining  beat  quantity  of  the  item 

Uf (Nk)  =  Up  time  expressed  as  function  of  available  quantity 
of  k-Sb  item 


Nk  =  Number  of  the  item  available 

C1  -  Total  weapon  system  cost  except  the  cost  of  providing 
the  k£b  item 

Ck  -  Cost  of  k^k  item 


This  ratio  factor  (R)  was  designed  for  support  program  analysis 
involving  complete  fleets  or  inventories  of  weapon  systems. 

The  trade-off  factor  (T)  was  developed  to  make  the  c/g  conceot  more 
usable  at  lower  levels  of  responsibility.  "Th  represents  a  weapon  system's 
(aircraft,  tank,  etc.}  dollar  cost  per  hour  i.e., 

ftwarad  tmlaUioa  aagt 

T  -  Number  of  available  hours 
during  planned  service  life 
of  system. 

Given  several  support  alternatives,  the  T  factor  is  calculated  and  used 
in  the  following  expression; 


NDB  -  AU  x  T  -  Cjj 

where:  NDB  *  Net  Dollar  Benafit 

Au  -  Predicted  increase  in  Uptime  as  result  of  support 

alternative  (e.g.  modification  to  the  weapon  system) 
2k 


T  =  Trade-off  factor  for  system 
=  Cost  of  support  alternative 


EXAMPLE  I 

AU 

LeI ml 

Cm 

(given) 

T 

(Calculated) 

NDB 

(Calculated) 

MOD  A 

lxlO5  hrs. 

$50/hr. 

*  ht 

MOD  B 

5xl04  tare. 

k-7m 

$50/hr. 

*"*2M 

MOD  C 

1x10^  hrs. 

*  -«M 

$50/hr. 

From  example  I, 

it  can  be  seen  that  proposed  modification  A  is 

considered  a  good  C/  investment  while  proposed  modifications  B  and  C  are 
not.  The  situation  may  be  such  that  non-cost/effective  alternatives  must 
be  implemented  (i.e.  flight  safety,  etc..),  however,  the  approving  agency 
should  beware  of  the  c/jS  implications  of  the  investment. 

The  following  expression  uses  the  above  described  T  factor  in  measuring 
organizational  support  program's  effectiveness: 


a  _ 

R  -  T(P)  T  C8q 

where  R  =  Organizational  Suoport  Program's  Effectiveness 
U  -  Uptime  hours  of  system 
D  =  Downtime  hours  system 
T  =  Calculated  T  Factor 

P  =  Quantity  of  weapons  system  hours  during  program 
Cs0  =  Total  coat  of  organisational  level  support  (personnel,  technical 
data,  etc.) 

k  *  A  constant  modifying  downtime  hours 
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p 

Those  basic  tools  are  available  to  measure  /_  in  a  gross  manner  and  to 

£< 

provide  the  data  necessary  to  make  more  informed  judgments  on  costly 
alternative  actions.  The  need  for  reliable  and  accurate  data  for  these 
type  of  models  is  obvious  as  is  the  necessity  for  insuring  that  they  be  kept 
updated. 

The  Navy  has  available  models  and  rules  described  here.  As 
mentioned!  these  are  in  varying  degrees  of  application  -  from  research- to- 
test- to  near  implementation.  Whatever  the  degree  of  current  use,  the  0/ 
approach  is  gaining  popularity  as  a  measuring  tool  in  the  Navy. 
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William  W.  Klare 
Lt  Colonel  Floyd  Revere 


Recent  Mathematical  Modeling/Cost  Effectiveness 
Projects  in  the  Department  of  the  Air  Force 


A  year  has  passed  since  the  Air  Force  embarked  on  an  extended 
formal  Mathematical  Modeling/Cost  Effectiveness  Program.  A  brief 
review  of  the  background  which  lead  to  this  extension  will  serve  as  a 
starting  point  for  an  illustration  of  how  these  techniques  are  being  used 
by  the  Air  Force. 

At  DOD's  request,  the  Air  Force  Logistics  Command  and  the  Air 
Force  Systems  Command,  with  the  assistance  of  the  Strategic  Air 
Command,  prepared  a  summary  of  the  computerized  cost  effectiveness 
efforts  used  on  the  Minute  man  weapon  system.  Hence,  successes  in 
support  planning  on  the  Minute  man  form  the  basis  for  our  current 
research  and  use  cf  simulation  and  mathematical  models.  The  Minuteman 
planning  efforts  were  initiated  with  a  series  of  conferences  held  in  late 
1961  and  1962  for  the  purpose  of  procuring  maintenance  ground  equipment 
and  quantifying  personnel  requirements.  A  new  technique  was  developed 
and  tried  for  determining  Minuteman  Maintenance  Ground  Equipment 
(MGE)  quantities  in  the  Spring  of  1962.  The  technique  introduced  on 
Minuteman  takes  into  consideration  three  critical  and  frequently  over¬ 
looked  factors  when  computing  manpower  and  equipment  requirements. 
These  are:  the  randomness  of  failure  or  uncertainty  as  to  when  a 
malfunction  will  occur;  the  workshift  policy  with  respect  to  when  mainte¬ 
nance  personnel  are  on  duty;  and  the  point  of  total  minimum  cost  or  the 
point  of  marginal  increase  in  system  capability  weighed  against  the 
marginal  increase  in  cost  of  providing  additional  resources.  In  practical 
application,  a  set  of  ''equal  cost  curves"  was  produced  specifically 
tailored  to  the  Minuteman  (Chart  #1).  To  use  these  curves,  the  provisioner 
had  to  compute  the  days  per  month  the  resource  would  spend  in  transit, 
in  repair  or  performing  its  function,  and  the  cost  of  the  resource.  Using 
thin  technique,  the  desired  quantity  from  a  cost  effectiveness  point  of  view 
can  be  determined  and  the  penalty  involved  can  be  evaluated  if  the  proper 
quantity  is  not  chosen.  Also,  it  was  possible  to  examine  the  effects  of 
failure  to  meet  reliability,  maintainability,  or  equipment  cost  estimates 
from  both  the  point  of  view  of  consequent  changes  in  requirements  and  of 
force  readiness  degradation. 

Our  presentation,  describing  in  detail  these  Minuteman  techniques, 
was  given  to  the  Air  Staff  and  to  the  Department  of  Defense  ealy  in  1964. 

At  this  point  it  was  determined  that  we  should  move  forward  with  similar 
techniques  and  procedures  on  the  F-4C  and  the  F-lll. 


27 


To  centrally  control  the  management  of  this  effort,  a  Joint 
Command  Steering  Group  was  formed,  chaired  by  representatives  of 
AFLC  and  AFSC,  with  participation  from  the  using  command,  augmented 
by  members  from  each  command's  subordinate  echelons.  Although  the 
Steering  Group  deals  primarily  in  techniques,  its  objective  remains  the 
acquisition  and  support  of  a  weapon  through  its  planned  service  life  at  a 
total  minimum  cost  or  to  obtain  an  economic  balance  between  the  dollars 
that  are  invested  in  capital  equipment  and  the  dollars  that  will  be  required 
to  support  the  system. 

To  simplify,  with  little  or  no  dollars  invested  in  support  element 
resources  a  downtime  cost  can  be  anticipated.  As  more  resources  are 
invested  downtime  cost  decreases.  However,  a  point  is  reached  where 
more  dollars  invested  in  resources  will  not  produce  a  comparable  return 
(Chart  #2). 

The  high  downtime  cost  is  caused  by  the  weapon  waiting  or  "queueing" 
for  resources  such  as  personnel,  spares,  and  AGE.  This  waiting  is  caused 
by  the  randomness  of  failure  and  subsequent  variability  in  demand.  Under 
today's  techniques,  resources  are  provided  based  on  the  average  demand. 
However,  optimum  resources  are  usually  somewhere  between  the  average 
and  nuudnjim  demand.  Using  queueing  theory,  the  point  at  which  the 
optimum  or  desired  quantity  should  be  can  be  determined.  On  Minuteman, 
queueing  theory  was  used  along  with  reliability  data  to  computer  generate 
equal  cost  curves  for  use  by  the  pcovisioner  In  establishing  the  optimum 
stock  level  requirement  as  previously  discussed. 

In  addition  to  the  problem  of  optimising  downtime  costs,  there  are 
other  economic  considerations  to  be  resolved  using  math  models.  These 
fall  into  the  repair  decision  area.  Is  it  cheaper  to  repair  an  item  or  throw 
it  away?  Is  it  cheaper  to  bLCkstream  repair  back  at  the  depot?  The  other 
consideration  was  whether  we  even  bring  repair  of  Hie  Item  in-house.  The 
number  of  reparables  that  would  generate  influences  this  kind  of  decision. 

If  a  base  had  a  low  reparable  generation,  the  investment  in  base  repair 
capability  could  not  be  amortized. 

As  mentioned,  we  launched  a  formal  program  to  attempt  the  applica¬ 
tion  of  cost  effectiveness  modeling  techniques  to  the  F-4C  and  F-lll.  We 
learned  early  that  the  techniques  that  were  used  on  Minuteman  could  not 
be  applied  directly  as  there  was  no  acceptable  way  to  determine  the  cost 
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of  an  hour  of  aircraft  downtime.  In  the  Minuteman  program,  $80  an 
hour  was  used  for  the  cost  of  an  hour  of  downtime.  This  cost  was 
derived  and  used  from  a  ten  year  service  life  compared  to  total  weapon 
acquisition  and  operational  cost. 

Research  then  was  necessary  for  other  available  procedures  or 
models  that  could  be  used.  This  research  revealed  that  General  Dynamics 
in  Fort  Worth  was  using  logistic  models  on  the  F-lll,  and  it  was  found 
that  four  particular  RAND  developed  models  used  the  techniques  that  had 
been  used  successfully  in  support  planning  for  the  Minuteman. 

With  their  work' on  the  B-58  as  precedent,  General  Dynamics  is 
relying  on  several  models  for  specific  assistance  during  the  production 
of  the  F-lll  (GD/FW  Brochure,  MR-0-84,  18  May  1964,  Description  of 
Logistics  Models  on  F-lll  Program). 

Their  Subsystems  Simulation  Model  is  used  to  evaluate  the  detailed 
maintenance  and  logistics  problems  of  a  specific  subsystem  of  the  aircraft 
(e.g. ,  fire  control,  hydraulics,  flight  control,  etc.).  This  model  computes 
the  expectea  frequency  of  maintenance  and  downtime  and  the  requirements 
for  various  personnel  skills,  equipment  and  facilities,  and  the  expected 
removal  rates  of  line  removable  units  for  each  subsystem. 

The  Network  Analysis  Model  was  developed  to  combine  the  mainte¬ 
nance  characteristics  of  each  subsystem  to  describe  the  overall  downtime 
characteristics  of  the  aircraft  in  a  perfect  logistics  environment  (1.  e. , 
adequate  spares,  personnel,  etc. ,  100  percent  of  the  time). 

The  Base  Maintenance  and  Operations  Model  was  developed  to 
measure  the  operational  capability  of  the  aircraft  in  its  operational  environ¬ 
ment.  This  model  utilizes  the  outputs  from  the  above-mentioned  GD  models 
and  combines  them  with  flight  schedules  and  other  maintenance  and  operational 
policies  to  simulate  the  activities  of  the  aircraft  base.  The  principal  output 
of  this  model  is  the  operational  readiness  of  a  squadron  or  wing  and  the 
magnitude  of  the  logistics  problem. 

The  Cost  Model  Is  a  computer  program  weapon  systems  cost  model 
used  to  obtain  RDT&E,  investment  end  operational  costs.  Cost  prediction 
equations  are  used  to  estimate  costs.  Computer  printouts  are  made  by 
specific  cost  categories  such  as  spares,  personnel,  facilities,  equipment, 
etc. 
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The  Effectiveness  Simulation  Model  measures  the  operational 
capability  of  the  aircraft  in  its  flight  environment.  The  output  of  this 
model  provides  the  aircraft  availability  for  flying.  It  simulates  the 
flight  operations  for  up  to  100  aircraft  and  computes  airborne  effective¬ 
ness.  It  will  also  accept  cost  inputs  from  the  cost  model  for  computing 
cost  effectiveness  as  desired. 

General  Dynamics  uses  these  models  separately  to  analyse  specific 
problems  or  together  to  produce  a  complete  system  analysis. 

Conversely,  the  F-4C  had  no  comparable  effort  under  way  and,  as 
this  system  was  further  along  in  the  acquisition  phase  than  die  F-lll,  the 
Joint  Steering  Committee  decided  to  concentrate  on  the  F-4C  with  the 
Intent  of  returning  to  the  F-lll  program  when  our  in-house  competence 
had  increased. 

Along  this  line,  then,  the  RAND  models  were  applied  to  the  F-4C 
by  the  preparation  of  jointly  prepared  TAC  directive  initiating  data 
collection  at  the  First  Operational  F-4C  Wing  at  MacDill  Air  Force  Base, 
Florida. 

In  this  directive,  the  836th  Air  Division  is  charged  with  the  collection 
and  validation  of  data  in  addition  to  that  normally  required  (AFM  66- 1  and 
AFM  65-110).  One  of  these  additional  items  is  the  "when  discovered  time. " 
This  is  necessary  to  realistically  separate  the  initial  delays  from  the 
maintenance  time  experienced  on  a  particular  failure.  Others  are:  "when 
work  started;''  "delay  information  with  reasons  for  delay;"  "when  work  Is 
completed;"  "team  size;"  "equipment  type  and  time  of  use;”  "mission 
information;"  and  "operating  time  at  failure  for  time  change  replacement 
and  Elapsed  Time  Indicator  installed. "  These  data  are  fed  by  punch  cards 
into  the  computers  to  exercise  a  technique  developed  by  RAND  in  the  Manning 
and  Equipping  area  (RAND  Memorandum  RM-3370- PR- Manning  and  Equipping 
Decisions)  (Chart  #3). 

This  technique  is  designed  to  accurately  Identify  the  maintenance 
generated  by  operational  requirements  both  in  the  amount  of  work  and  the 
time  at  which  it  was  required.  Such  identification  is  necessary  in  order 
to  evaluate  flying  schedules,  estimate  the  resulting  workloads  and  plan  work 
schedules  to  minimize  overtime. 
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Management  is  provided  several  easily  read  graphic  displays  which 
assist  in  base  level  action.  These  displays  present: 

Information  about  the  time  when  work  was  first  known  to 
maintenance  and  when  it  was  done. 

Identification  of  delays  of  return  of  aircraft  to  operational 

readiness. 


Summary  of  manpower  utilization  by  hour  /day/aircraft  for 
personnel  requirements  determination  and  for  workshift  planning  for 
any  given  flying  program. 

Recording  of  Job  elapsed  times  in  addition  to  job  frequency. 

Computation  of  sortie  recovery  capabilities. 

Examination  of  Impact  of  maintenance  and  operations  scheduling 
on  the  flight  program  and  on  operational  readiness. 

Although  outside  the  purview  of  the  Joint  Steering  Group,  TAC  has 
extended  the  use  of  this  model  to  the  maximum  effort  aircraft,  the  C- 130 
at  Pope  Air  Force  Base,  North  Carolina.  MATS  is  also  investigating  it 
for  use  on  the  C-141  and  the  C-5A. 

Using  the  manning  and  equipping  technique  output  our  next  model, 
die  base  operations  model  or  8AMSOM  (RAND  Memorandum  RM-4077-PR- 
Support  Availability  Multi-System  Operations  Model)  (Chart  #4),  is  a  tool 
for  simulation  of  the  base  level  activities  that  are  associated  with  operating 
aircraft  at  a  specified  sortie  schedule.  For  various  sortie  schedules,  the 
model  yields  the  number  of  sorties  that  were  launched  and  provides  an 
operational  ready  rate  within  the  constraints  of  personnel,  equipment, 
facilities,  reliability,  and  malfunction  rates,  the  time  required  to  repair, 
and  the  parts  delays  that  are  encountered.  It  identifies  the  cause  and 
magnitude  of  delays  in  aircraft  turnaround.  It  should  be  particularly 
useful  to  the  System  Project  Office  (AFSC)  and  System  Support  Manager 
(AFLC)  during  the  program  definition  and  acquisition  phase  to  evaluate 
contractor  engineering  proposals,  determine  the  AGE  requirements, 
determine  their  personnel  requirements,  and  provides  a  base  line  fotr 
measuring  system  effectiveness  in  terms  of  the  "operational  ready  rate, " 
the  "not  operational  ready,  maintenance,"  rate  and  the  "not  operational 
ready,  supply"  rate.  In  the  operational  phase,  it  can  be  used  for  measuring 
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the  effects  of  proposed  changes  In  operational  plans  and  validate  the 
expected  resources  that  are  needed.  The  model  requires  the  use  of 
large  scale  computers,  relatively  sophisticated  inputs,  and  people  who 
are  thoroughly  grounded  in  the  details  of  the  model.  It  requires  a  high 
level  of  understanding  by  its  users. 

This  model  has  been  programmed  and  successfully  operated  by 
representatives  of  the  two  Commands.  To  the  degree  that  our  personnel 
have  learned  the  procedures  of  modeling  the  program  can  be  deemed 
successful.  However,  specific  instances  of  assistance  to  the  F-4C 
program  cannot  be  cited  at  this  point. 

While  commenting  on  SAM90M  is  appropriate  to  bring  out  that 
during  Phase  I  Studies  of  the  Program  Definition  Phase  of  the  ADO- 12 
(Vertical  Short  Take-Off  and  Landing,  or  VSTOL),  an  advanced  fighter 
weapon  system,  the  SAMSOM  model  was  used  quite  extensively  by  two 
competing  contractors.  Areas  in  which  investigations  were  made  were 
simulation  of  fighter  Interceptor  operations,  comparisons  between 
alternative  basing  postures  for  tactical  fighter  bombers  and  simulation 
of  selected  operational  and  logistics  concepts.  As  evidenced  by  its  use 
in  the  ADO- 12,  computerised  simulation  is  becoming  an  indispensable 
tool  far  evaluating  new  systems  as  they  enter  the  program  definition 
and  acquisition  phases. 

The  third  RAND  model  and  perhaps  the  most  promising  of  the 
models  from  a  long  term  Supply  standpoint  in  the  Base  Stockage  Model 
(RAND  Memorandum  RM-3644- PR-Base  Stockage  Model)  (Chart  #5). 

It  la  uaed  to  set  an  optimum  base  stock  level  far  recoverable  type  items 
where  the  optimum  is  equal  to  the  minimum  stock  value  in  dollars  for  a 
specified  fill  rate  or  the  maximum  fill  rate  is  achieved  for  a  specified 
dollar  restraint.  Levels  are  set  base  by  base,  using  the  base's  past  six 
months  demand  or  in  the  case  of  new  aircraft  the  engineered  estimates 
of  demand.  The  model  considers  the  demands  at  base  level,  the  percent 
of  reparables  repaired  at  the  base,  the  base  repair  time,  the  depot 
resupply  time,  and  the  unit  cost.  The  model  assumes  a  aero  stock  level 
for  every  item  at  the  base  and  then  poses  the  question,  'What  is  the 
greatest  amount  of  fill  protection  per  dollar  unit  of  stock?”  The  model 
assigns  a  unit  of  stock  to  this  item  and  then  determines  the  next  largest 
amount  of  protection  per  dollar  unit  of  stock  and  so  on.  The  method 
begins  by  stocking  low  cost  high  demand  reparables  and  works  down  to 
low  demand  high  cost  items.  The  allocation  process  continues  until  the 
target  aggregate  base  fill  rate  has  been  obtained,  at  which  time  the 
computer  prints  out  the  item  and  summary  results. 
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The  model  was  tested  by  RAND  at  Andrews  Air  Force  Base  in  April 
1962  on  2,802  reparable  items.  At  that  time,  Andrews  had  2. 5  million 
dollars  invested  in  base  inventory  and  was  achieving  an  actual  fill  rate 
of  61. 3  percent.  For  this  same  dollar  Investment,  the  model  projected 
target  fill  rates  and  measured  the  actual  fill  rates  against  what  was 
targeted.  If  the  base  had  been  stocked  according  to  the  model,  a  fill 
rate  of  approximately  92%  would  have  been  achieved  The  model  could 
have  achieved  the  same  fill  rate  as  Andrews  achieved  under  the  2. 5 
million  dollars  for  an  investment  of  631,000  dollars.  Ogden  Air  Materiel 
Area  has  used  the  model  to  project  their  initial  lay- in  of  spares  quantities 
and  are  now  working  with  the  Tactical  Air  Command  to  make  base  lay-ins 
possibly  at  George  Air  Force  Base.  OCAMA  is  going  to  use  the  model  to 
test  the  stock  levels  laid  in  for  BOMAHC  and  Minuteman.  Sacramento 
Air  Materiel  Area  has  also  run  the  model  to  project  test  table  requirements 
for  Category  I  and  n  tests.  They  are  presently  working  with  the  System 
Project  Office  to  determine  whether  or  not  they  will  use  these  forecasts 
for  the  lay-in  of  the  test  tables.  We  intend  to  use  the  model  if  it  proves 
successful  to  make  provisioning  decisions  for  base  lay- in  on  the  F-lll. 

The  last  model,  the  base  versus  depot  repair  model  (RAlfD  Memo¬ 
randum  RM-384S- PR-Base  Versus  Depot  Repair  Decision)  (Chart  #6)  is 
used  to  determine  economic  level  of  repair  by  pricing  out  the  cost  of 
establishing  a  base  repair  capability  versus  savings  that  would  accrue 
from  reduction  in  base  resupply  time.  It  considers  such  factors  as  the 
cost  of  AGE  and  skills,  the  volume  of  repair  involved,  the  base  repair 
time  or  the  depot  resupply  time,  the  depot  costs,  the  stock  levels  of  end 
items  that  will  be  required  if  the  item  is  depot  repaired,  and  the  cost  of 
bit  and  piece  support.  It  provides  a  display  of  the  differential  costs  for 
the  various  degrees  of  base  repair  and  its  primary  value  is  at  the  source 
coding  conference  to  establish  the  repair  level  codes. 

OOAMA  has  used  the  model  on  the  F-4C  fire  control  system.  SMAMA 
will  use  it  for  making  repair  level  decisions  on  the  F-lll  upon  completion 
of  the  machine  programming  being  undertaken  by  RAND.  Hie  evaluation 
will  continue  through  the  F-lll  program.  We  hope  to  gain  sufficient 
knowledge  in  the  early  phases  of  the  F-  111  to  apply  it  to  future  weapons. 

In  summary  we  have  been  pioneering  for  a  year,  stretching  tl*e 
technical  skills  of  our  people  and  machines.  Although  industry  to  some 
degree  and  certain  study  and  research  groups  have  had  experience  in  these 
described  techniqiies,  this  is  the  first  Air  Force  attempt  to  bridge  the  gap 
from  the  laboratory  to  the  operational  environment.  It  has  not  been  easy 
nor  do  we  expect  it  to  ease  up. 
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We  anticipate  a  requirement  for  an  evaluation  of  c  r  entire 
program  sometime  in  mid  Summer .  Pending  this  detailed  evaluation 
these  comments  appear  supportable  as  of  today: 

Success  requires  that  the  user,  developer,  and  supporter 
actively  participate  in  simulation  and  modeling. 

Early  Initiation  and  participation  are  required  to  preclude 
operational  experience  from  overrunning  simulation.  However,  feedback 
data  from  operational  experience  is  necessary  to  validate  the  simulation 
techniques. 

A  high  level  in-house  competence  is  required  to  react  to 
contractors'  models  outputs. 

No  militarily  satisfactory  simulation  model  has  been  identified 
If  we  define  satisfactory  as  simple,  operationally  complete,  automatic, 
realistic  and  multi-purpose. 

The  Manning  and  Equipping  Model  provides  useful  data  to  TAC, 
SPO  and  the  SSM. 

The  Base  Stockage  Model  may  point  the  way  to  a  more  realistic 
and  economical  placement  of  spares  at  the  base  level. 

The  Base  versus  Depot  Repair  Model  promises  a  more  systematic 
approach  to  the  repair  level  decision. 
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MILITARY  ESSENTIALITY 


by 

W.  H.  Marlow 


INTRODUCTION 

Our  aim  is  to  describe  some  techniques  for  measuring  military  essentiality 
and  to  illustrate  applications  for  cost -effectiveness  comparisons.  We  suppose  that 
we  are  given  some  definite  set  of  military  items  such  as  a  collection  of  equipments 
or  repair  parts*  or  even  several  different  weapons  systems.  We  suppose  further 
that  each  item  has  some  intrinsic  value  in  the  sense  that  its  use.  or  availability  for 
use,  can  in  some  way  contribute  to  gaining  military  objectives.  In  this  way  we  are 
led  to  the  notion  of  a  military  essentiality  system  which  will  make  it  possible  to 
compare  the  values  of  the  items. 

We  will  say  that  we  have  a  military  essentiality  system  whenever  the  follow¬ 
ing  conditions  are  met.  First,  a  set  of  military  objectives  must  be  fixed.  Usually* 
this  takes  the  form  of  a  mission  or  set  of  missions.  Second,  a  definite  set  of 
military  items  must  be  specified.  This  set  will  form  the  domain  for  comparison 
of  military  essentiality.  Third,  the  possible  means  for  contributing  to  the  fixed 


objective*  muit  be  known  for  each  item.  These  are  the  attributes  that  are  to  be 
compared.  Finally,  a  precedence  list  must  be  given  which  serves  to  rank  all  the 
items  in  order  of  military  essentiality:  1st.  2nd.  ....  last.  Two  different  iteme 
either  have  the  same  rank  or  else  one  has  the  higher  rank  which  means  that  its 
attributes  are  more  important  to  the  mission.  In  this  way  we  obtain  an  ordinal 
system  In  the  sense  that  we  have  determined  only  the  relative  order  of  worth; 
e.  g.,  we  may  not  be  able  to  conclude  that  one  item  is  twice  as  important  as 
another  but  only  that  it  is  more  important.  If  the  precedence  list  serves  to 
rank  all  the  items  on  a  numerical  scale  so  that  rank  a  is  twice  as  important 
as  rank  a/2,  then  we  have  a  cardinal  system. 

The  above  approach  equates  military  essentiality  to  accomplishment  of 
military  objectives.  In  fact,  the  term  "essentiality"  could  be  replaced  by 
"effectiveness"  or  even  "readiness"  with  practically  no  distortion  of  meaning 
in  present  context.  This  is  true  because  it  is  possible  to  select  missions  and 
sets  of  items  so  that  military  essentiality  does  correspond  exactly  to  military 
effectiveness  or  readiness. 

Our  principal  vehicle  for  exposition  will  be  the  Polaris  Military  Essentia¬ 
lity  System  as  developed  by  Denicoff  et  al.  [l].  After  describing  this  system  we 
illustrate  various  applications  to  allocation  problems  of  material  support, 
notably  some  involving  repair  parts.  Our  basis  is  the  fundamental  logistics 
model  of  Denicoff  et  al.  [2],  We  provide  illustrations  of  ordinal  methods  wherein 
military  essentiality  is  employed  as  a  priority  designator.  Further  examples 
are  given  employing  cardinal  methods  wherein  military  essentiality  is  measured 
on  a  numerical  zero  to  unity  scale.  We  consider  the  joint  use  of  effectiveness 
measures  and  cost  data  so  that  the  examples  deserve  the  label  "cost-effectiveness". 
We  conclude  with  a  brief  discussion  of  prospects  for  better  military  essentiality 
systems  and  improved  applications. 
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THE  POLARIS  MILITARY  ESSENTIALITY  SYSTEM 


The  subject  system  was  developed  to  measure  various  effects  of  failures 
on  the  Polaris  weapons  system.  Three  different  levels  were  considered:  equip¬ 
ment  component  and  wearable  installed  part.  Failures  at  one  level  were  studied 
for  their  effect  at  higher  levels  culminating  in  consideration  of  effects  on  the 
Polaris  mission.  Five  military  essentiality  systems  were  developedia  system  was 
required  at  eachof  the  three  levels*  one  was  developed  to  rank  component -equipment 
combinations,  and  finally  an  overall  system  was  derived  to  handle  part -component- 
equipment- mission  relations.  This  final  system  will  be  the  only  one  that  we  need 
consider. 

We  restrict  our  attention  to  the  Polaris  mission:  the  submarine  is  to 
carry  out  a  normal  patrol  cycle  which  will  mean  that  there  can  be  no  external 
supply  or  maintenance  support.  The  deployed  crew  must  rely  entirely  on  them- 
'  selves  and  their  available  material  resources  in  order  to  achieve  the  required 
states  of  performance  during  patrol. 

The  set  of  military  items  in  question  are  the  wearable  installed  parts 
which  go  together  to  make  up  the  entire  weapons  system.  We  must  consider 
parent  components  and  equipments  since  the  same  part  might  have  different 
significance  according  to  its  different  installations.  A  common  example 
would  be  a  transistor  which  is  installed  in  both  fire  control  computer  and  in  a  stereo 
music  system.  Thus,  the  entire  set  of  part -component -equipment  combinations 
must  be  specified  as  the  domain  for  military  essentiality  measurements. 

Next,  we  must  relate  each  of  our  items  to  the  desired  military  objectives. 
This  is  accomplished  in  the  subject  system  by  means  of  questionnaireswhich  de¬ 
termine  precise  effects  of  failures.  Consider  the  equipment  level.  We  suppose  that 
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a  failure  occurs  on  the  first  day  of  patrol  such  that  all  installed  units  of  the  given 
equipment  are  lost  with  no  possibility  of  repair.  One  of  the  choices  is  made  to 
describe  the  mission  effect:  "total  degradation"  means  that  patrol  would  have  to 
be  terminated;  one  of  "partial"  or  "minimal"  is  specified  in  case  patrol  would 
not  be  terminated.  Two  additional  questions,  also  with  three  choices  each  are 
asked  relative  to  the  consequences  of  failure  of  a  single  unit.  The  second  ques¬ 
tion  relates  to  redundancy  and  the  third  to  alternatives.  There  are  a  total  of  27 
possibilities:  the  highest  worth  equipment  is  one  whose  loss  would  totally  degrade 
the  mission  capability  and  for  which  there  is  no  redundant  or  alternative  equipment 
available.  At  the  other  extreme,  failure  of  the  least  essential  equipment  would 
have  a  negligible  effect  on  the  mission,  and  furthermore,  redundant  and  alterna¬ 
tive  equipments  exist  with  comparable  capability  to  the  equipment  itself.  A 
similar  questionnaire  is  completed  for  each  component  with  the  feature  that  effect  on 
parent  equipment,  equipment  effect,  replaces  the  former  mission  effect.  Finally, 
two  "yes  or  no"  questions  are  asked  concerning  each  installed  part.  Can  the 
parent  component  operate  satisfactorily  for  the  entire  patrol  period  lacking  one 
unit  of  the  part?  Is  the  part  installable  during  patrol?  These  are  the  data  which 
enable  us  to  determine  the  possible  contribution  by  each  item,  e.  g.,  each  repair 
part,  to  the  mission. 

The  actual  ranking  system  or  precedence  list  turned  out  to  have  116 
levels.  If  two  items  belong  to  the  same  military  essentiality  class  (MEC),  then 
by  definition  they  are  equally  important.  This  system  was  derived  systematically 
from  certain  basic  principles  as  shown  by  Denicoff  et  al.  [l].  It  is  of  some 
interest  to  note  that  the  original  (27)(27)  a  729  categories  for  component  - 
equipments  were  reduced  to  29  MEC's  as  outlined  ir  Table  1. 
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MEC 

RELATIVE 

ESSENTIALITY 

116 

Highest 

115-94 

High 

93-91 

Intermediate 

90-88 

Low 

Table  1  -  MEC  code  assignment* 


ORDINAL  METHODS 

In  this  section  we  illustrate  the  use  of  the  Polaris  MEC  system 
where  the  precedence  list  is  used  in  ordinal  fashion  only.  e.  g. ,  as  a  priority 
designator.  We  will  phrase  our  examples  in  term#  of  allowance  lists. 

Such  a  list  specifies  the  repair  parts  which  must  be  carried  on  board  ship. 
Future  demands  for  the  repair  parts  are  uncertain  and  there  exist  limited 
stowage  space  and  limited  funds  for  allocation.  We  will  use  MEC  values 
to  indicate  effectiveness  while  costs  are  expressed  in  cubic  fee*  in 
dollars,  or  in  some  combination.  We  consider  future  demands  for  a 
repair  part  to  be  represented  by  a  random  variable  X  .  For  the  time 
period  of  interest,  say  one  patrol  period  for  a  Polaris  submarine. 

Pr  {X  *  i}  *  f(i).  (i  *  0*  1»  2,  . 

Then  the  value,  F(k)  *  Pr  fX  «  k},  of  the  cumulative  represents  the  pro¬ 
bability  that  demand  will  not  exceed  k  units.  We  will  assume  thatderr^nds  for 
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different  repair  parts  are  independent.  Different  repair  parts  will  in  general 
have  different  distributions  so  that  where  necessary  we  will  use  F^  for 
the  distribution  associated  with  the  jth  part.  It  turns  out  that  there  are 
about  2000  items  in  MEC  116  for  a  Polaris  submarine  together  with  cllof 
its  weapons  systems.  By  definition,  each  of  these  items  is  an  absolutely  es¬ 
sential  repair  part.  In  case  there  is  a  i<  lure  requiring  replacement  of  such 
a  part  and  there  are  insufficient  units  in  stock,  then  the  submarine  must 
terminate  patrol.  This  leads  to 

Example  1.  Because  of  the  absolute  essentiality  of  repair  parts  in 
MEC  116,  we  argue  that  these  parts  should  be  given  overriding  pr.jrity. 
Effectiveness  of  repair  part  support  requires  that  there  be  practically  no 
shortages  of  such  parts.  Expected  overall  effectiveness  of  the  weapons 
system  could  oe  analyzed  with  the  result  that  a  minimum  threshold,  say 
0.99,  is  specitied  for  the  probability  that  demand  will  not  exceed  supply 
for  any  of  the.  say,  n  iteme  in  MEC  116.  This  can  then  be  immediately 
transformed  into  an  equation  for  determining  the  allowance  quantity  to  be 
placed  cn  board  for  the  jth  item.  That  is, recalling  that  the  items  are 
assumed  to  be  independent,  we  could  use  the  following  procedure  for  a  uni¬ 
form  allocation  of  readiness  over  the  n  different  parts.  We  stock  kj 
units  of  the  jth  part  according  to 

kj  a  min  [  F^(i)  >  t]  where  t  =  (G,99)1^n. 

In  words,  t  is  a  critical  threshold  for  each  repair  part  in  MEC  116;  each 
part  is  stocked  in  quantity  such  that  the  probability  that  demand  will  not  exceed 
supply  equal e  at  least  t.  If  n  *  2000,  then  t  *  0.999995;  however, 

in  practice  t  can  be  chosen  somewhat  smaller,  e.  g.»  0.999990  with  the 

resuit  that  the  product  of  the  2000  F^  will  still  exceed  0.99.  The  reason 

{ j) 

is  simple:  for  each  j,  F  (k«)  is  generally  strictly  greater  than  t. 
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In  this  example  MEC  116  has  been  treated  with  overriding 
priority  because  of  its  significance  for  effectiveness  of  the  weapons 
system.  Cost  considerations  are  not  used  except  in  a  general  way  to 
limit  the  allocation  of  space  and  funds;  these  resources  are  simply 
expended  as  necessary  prior  to  allocation  to  the  other  MEC  groups. 

Example  2.  Let  us  consider  MEC  groups  115,  114,.,.,  94 
which  constitute  the  remainder  of  the  "high  worth"classification.  We 
could  do  something  similar  to  the  procedure  for  MEC  116  and  let  t  be 
set  at  an  appropriate  value  for  each  MEC  group.  However,  it  turns  out 
to  be  more  promising  to  let  t  vary,  item  by  item,  as  a  function  of  MEC, 
unit  packaged  stowage  requirement  or  cube  in  cubic  feet,  and  unit 
dollar  value  or  price  in  dollars.  We  will  furnish  details  below  in  Example 
3.  At  present  we  wish  to  use  the  MEC  code  as  a  priority  so  as  to  pre-empt 
resources  in  some  manner  less  severe  than  in  Example  1.  Two  cases  are 
worthy  of  note.  First,  we  could  argue  that  there  should  be  at  least  one  unit 
stocked  of  each  repair  part  in  MEC  115,  114,  ....  94.  This  could  be  called 
an  MEC  override. Second,  we  might  wish  to  specify  a  minimum  probability 
threshold,  e.  g. ,  a  minimum  protection  of  t*,  so  that  t'  =  max  (t,  t*) 
would  be  used  where  t  is  the  "normal"  function  of  MEC  cube  and  price. 

Some  effectiveness  considerations  which  could  lead  to  this  latter  procedure 
are  illustrated  by  repair  parts  for  certain  sub-systems  for  which  minimum 
performance  probabilities  are  specified.  For  example,  there  maybe  50 
parts  spread  over  115  to  94  for  which  a  certain  joint  probability  determines 
the  minimum  protection  t*. 

CARDINAL  METHODS 

Let  us  suppose  that  we  are  interested  in  applying  a  given  military  essential¬ 
ity  system.  Then,  although  we  are  willing  to  retain  the  precedence  list,  it  may  turn 
out  that  actual  magnitudes  must  be  assigned  to  military  essentiality .  This  would 
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happen  if  some  mathematical  model  were  to  be  used  that  required  a  single 
numerical  scale  for  both  effectiveness  and  costs.  The  nature  of  the  appli¬ 
cation  and  the  details  of  the  original  essentiality  system  would  of  course 
have  to  be  considered  along  with  the  model  before  cardinal  values  could  be 
assigned,  Indeed,  it  would  be  rare  that  a  numerical  scale  could  be  chosen 
for  essentiality  independent  of  the  details  of  proposed  application.  Some¬ 
thing  similar  often  applies  to  costs,  even  in  dollar  values,  which  must  be 
standardized  or  rescaled  for  use  in  a  numerical  application.  These  points 
will  be  illustrated  in 

Example  3.  We  consider  a  simplified  version  of  the  Polaris  model 
developed  by  Denicoff  et  al.  [2],  The  specific  case  we  present  is  an  adapt¬ 
ation  of  the  classic  "newsboy  problem".  This  problem  concerns  the  boy 
who  is  required  to  buy  his  papers  at  2  cents  and  sell  them  at  3  cents, 
and  is  not  allowed  to  return  his  unsold  papers.  Assuming  that  customers 
will  buy  his  papers  according  to  a  given  probability  distribution,  the  problem 

k 

is  to  maximize  expected  profit. 

Our  example  will  start  with  a  single  repair  part  candidate  for  placement 
on  a  Polaris  allowance  list.  As  the  counterparts  of  the  2  cents  and  (3  -  2)  cents, 
respectively,  we  have  the  following  two  positive  numbers  specified  relative  to  a 
single  patrol  period, 

A  *  penalty  per  unit  stocked  in  excess  of 

number  demanded  during  the  entire  patrol. 

B  =  penalty  per  unit  demanded  in  excess  of 
number  stocked  for  the  entire  patrol 

We  suppose  that  demand  for  the  item  will  be  represented  by  a  discrete  probability 
distribution  F  as  in  our  earlier  examples  except  that  now  we  require  that  F 
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have  a  finite  mean.  Then,  for  each  number  s  =  0,  1,  2,  .  .  .  our  expected 
loss  in  stocking  s  units  equals 

L(s)  s  a(s)  A  +  b(s)B 

8  00 

where  a(s)  *  .Z^(s-i)f{i)  and  b(s)  *  i^i  +  1^  “  s)  *(*) 

are  the  expected  surplus  and  shortage,  respectively.  It  turns  out  that  there 
is  an  optimal  quantity  to  stock  equalling 

n  *  min  [F(s)  >  t] 

s 


where 


t  =  B  /  (A  +  B  ) 

is  a  critical  probability  threshold  similar  to  some  appearing  in  our  earlier 
examples.  We  notice  that  t  is  determined  by  the  value  of  the  ratio  B/A 
so  that  it  would  suffice  to  specify  the  relative  value  of  B  to  A.  However, 
it  will  be  convenient  to  proceed  as  though  A  and  B  are  to  be  determined 
separately. 

The  object  in  our  present  example  is  to  select  numerical  values  for 
the  surplus  or  holding  cost,  A,  and  the  shortage  cost,  B.  Our  item  in 

question  is  described  by  a  unit  packaged  volume  or  cube,  c,  expressed 

_4  2 

in  units  of  say  10  cubic  feet  and  a  unit  price,  p,  expressed  in  10 

dollars,  i.  e. >  cents.  In  addition,  it  has  an  assigned  MEC,  w,  which  is 

one  of  the  numbers  116,  115,...,  59.  (We  stop  at  59  so  as  to  restrict 

attention  to  repair  parts  that  can  be  installed  on  patrol.) 


Let  us  consider  the  surplus  cost  A.  In  the  case  of  a  Polaris  submarine 
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the  critical  resources  are  stowage  space  and  dollars.  One  possibility  for 
assigning  A  is  to  use  a  weighted  sum  of  cubic  feet  and  dollar  value.  Since 
A  is  to  be  positive,  it  is  convenient  to  eliminate  zero  values  from  data 
errors  by  defining 


A  *  max[(yc  +  irp),  10"10] 

where  y  and  ir  are  positive  scaling  factors  to  be  discussed  below. 

The  unit  shortage  cost  B  should  certainly  depend  on  MEC  .  However, 
there  are  cogent  reasons  for  letting  it  vary  with  cube  and  price  as  well.  One 
useful  choice  is 


B  a  -  y  c  -  trp),  10“ 

where  a  is  a  scaling  factor  for  MEC.  An  exponential  is  used  for  several  V 

reasons.  First,  it  is  a  convenient  way  of  establishing  a  scale  with  a  maximum  -h, 

military  essentiality  value  of  unity  which  diminishes  essentially  to  zero. 

Second,  military  value  falls  off  sharply  and  "reasonably"  as  w  decreases 
from  116.  The  rate  of  decline  between  any  two  points  depends  of  course  on 
their  values  so  that  the  curve  flattens  out  as  lower  MEC  values  are  reached. 

Such  "exponential  decay"  is  the  determining  factor  in  our  choice.  We  have 
subtracted  As  >c  +  wp  from  the  exponential  so  as  to  take  credit  for  the 
cost  we  avoided  by  not  stocking  one  unit.  Looking  at  this  another  way,  we 
now  have  the  sum  A  +  B  expressed  as  a  function  of  MEC  alone;  this 
corresponds  to  using  MEC  as  the  sole  determinant  of  intrinsic  worth  in 
the  present  application.  Finally,  our  definition  of  B  taken  together  with 
that  for  A  serves  to  guarantee 

O  <  B/(A  +  B)  <  1 
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so  that  t  =  B/(a  +  B)  can  be  used  as  a  probability  threshold. 

Let  us  defer  discussion  of  the  scaling  factors  7,n  and  a  until  we 
have  indicated  how  we  would  compute  an  entire  allowance  list.  The  first 
step  in  such  a  computation  would  be  to  arrange  the  items  in  "priority"  order 
of  nonincreasing  essentiality*  starting  with  the  w  s  116  items.  Then 
for  fixed  7,  it  and  a  we  would  compute  n  for  each  item  in  order,  at 
the  same  time  accumulating  total  cube  and  total  price.  This  procedure 
would  correspond  to  optimizing  for  each  item  individually  without  any  res¬ 
trictions  on  total  cube  or  total  dollar  value  over  all  items.  When  we  reach 
the  end  of  the  list  after  the  first  time  through,  we  have  accumulated  total 
cube  <3^  and  total  price  P^.  These  totals  may  or  may  not  be  acceptable. 
For  simplicity,  let  us  suppose  that  overriding  significance  is  attached  to 
stowage  space  and  that  a  limit  C*  will  govern:  in  order  to  complete  an 

allowance  list  determination,  we  must  find  a  list  representing  C*  cubic 

*  * 

feet.  After  the  first  pass,  if  =  C  we  are  finished.  If  C^<  C  we 
would  diminish  some  or  all  of  7.  ir  and  a  and  make  a  second  pass  termin¬ 
ating  with  cubic  feet.  If  Cj  >  C*  we  would  increase  some  or  all 

of  7  ,  ir  and  a  and  try  again,  etc.  Exact  rules  would  have  to  be  specified 
relative  to  definite  objectives  for  a  particular  set  of  items.  For  example, 
if  "always"  C  >C*  then  we  may  have  to  stop  computing  midway  in  the 
priority  list  with  that  item  for  which  total  cube  first  exceeds  C*  .  This 
would  mean  that  items  below  this  cut-off  item  would  not  be  considered. 
Experience  at  the  Logistics  Research  Project  has  shown  that  it  is  quite 
easy  to  determine  empirically  some  ranges  for  7  ,  n  and  a  which  permit 
wide  choices  of  types  of  allowance  lists  (e.  g. ,  wide  ranges  in  terms  of 
varieties  of  items  stocked  with  n  ^  0  vs.  relatively  narrow  range 
stocking  mainly  high  MEC  items  in  large  quantities  each,  etc.).  In  addi¬ 
tion,  it  is  generally  true  that  calculations  do  not  have  to  be  terminated 
before  all  items  can  at  least  be  considered  for  placement  on  board.  However, 
in  the  present  paper  we  will  not  dwell  further  on  procedures  and  rules  for 
*  computing  allowance  lists. 
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Empirical  work  at  the  Logiitica  Research  Project  has  had  the  following 

illustrative  results.  A  reasonable  value  for  o  for  Polaris  allowance  lists 

has  been  o  ■  0. 10  as  summarised  in  Table  2  where  "scaled  essentiality" 

-  *  (116  -  w) 

denotes  e 


’ - - 

MEC 

SCALED 

ESSENTIALITY 

INVERSE 

ESSENTIALITY 

116 

1.00 

1.0 

108 

0.45 

2.2 

93 

0.  10 

10.0 

59 

0,003 

30D.O 

Table  2  -  MEC  scale  for  a  *  0.  10 

Since  cube  is  the  primary  constraint*  it  has  been  found  that  choosing  the  price 
scale  with  ir  a  10*6  permits  wide  latitude  of  total  cube.  A  representative 
Polaris  allowance  list  would  use  y  near  10*3, 

Tables  of  allowance  quantities  as  functions  of  MEC*  cube*  price  and 
F  are  contained  in  the  U.  S.  Navy  Special  Projects  Office  Instruction  [3]. 
These  tables  incorporate  the  parameters  specified  just  above  together  with 
some  special  rules  along  lines  described  in  Examples  1  and  2.  In  addition, 
apjdication  of  similar  overall  procedures  for  other  echelons  of  supply  are 
described  in  the  Instruction. 

In  summary*  our  present  example  illustrates  the  use  of  cardinal 
values  for  each  of  military  essentiality*  cube  and  price  together  with  a  loss 
minimization  model.  An  overall  cost-effectiveness  procedure  is  employed 
whose  structure  is  quite  complex.  Even  for  a  single  item,  the  optimum 
quantity  depends  on  the  associated  probability  distribution  together  with 
the  three  variables,  and  their  scaling  factors*  which  enter  computation  of 
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the  threshold  t  »  B/(A  +B)  .  Military  essentiality  enters  in  particularly  vital 
fashion  as  an  overall  adjustment  factor.  If  we  return  to  Table  2  and  consider 
MEC  93  and  the  right-hand  entry  10.0  we  may  make  the  following  observa¬ 
tion.  The  number  10.0  does  in  some  sense  mean  that  an  item  in  MEC  116 
is  10  times  as  essential  as  an  item  in  MEC  93.  However,  it  does  not  mean 
that  an  item  in  MEC  116  will  be  stocked  in  quantities  tenfold  larger.  Instead, 
it  means  that  the  exponential  scale  will  be  this  much  larger.  For  example,  consider 

items  alike  in  every  respect  except  MEC  and  for  which 

7c  +  ip:  0. 002 . 

Then  t  a  0.996  for  MEC  116  and  t  a  0.980  for  MEC  93. 

PROSPECTS 


The  methodology  described  above  for  measuring  and  applying  military 
essentiality  has  proved  to  be  of  great  value  for  practical  applications  within 
the  Navy.  There  are  many  ways  in  which  these  procedures  might  be  improved. 
In  the  present  section  we  give  brief  attention  to  a  few  specific  points. 

Considering  the  Polaris  Military  Essentiality  System  itself,  there  would 
be  interest  in  extending  it  so  that  additional  precision  could  be  applied  to  failures 
at  low  and  intermediate  MEC  leyels.  For  example,  how  should  on  account 
for  effects  of  simultaneous  failures  on  weapons  system  effectiveness? 

There  are,  of  course,  corresponding  problems  for  groups  of  weapons. 
Should  new  military  essentiality  systems  be  developed  or  can  we  adapt  the 
individual  systems  ?  In  the  case  of  the  Polaris  weapons  system  should  we  try 
to  apply  the  submarine  MEC  system  at  the  tender  or  depot  levels  ? 

Studies  are  underway  at  the  Logistics  Research  Project  aimed  at 
obtaining  answers  to  questions  such  as  those  posed  just  above.  Work  is  also 

53 


w 


fit 


TM-20836 


in  progress  on  developing  new  techniques  for  handling  effectiveness  models, 
e.  g.,  new  loss  functions  to  be  minimized,  in  order  to  improve  the  usefulness 
of  solutions  to  resource  allocation  problems.  In  conclusion,  we  would 
report  that  prospects  seem  excellent,  not  only  for  improving  the  measure¬ 
ment  of  military  essentiality,  but  for  applying  it  to  significant  military 
problems  which  heretofore  have  resisted  practical  solutions. 
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More  and  more  an  urgency  exists  at  all  levels  of  management 
to  improve  our  day-to-day  decisions  and  to  Improve  our  forecasts 
of  probable  future  events.  This  Is  particularly  true  in  the 
Department  of  Defense  where  present  and  future  weapon  system 
programs  and  other  major  program  changes  are  evaluated.  Many 
of  these  decisions  are  very  broad  and  complex  and  Involve  high 
national  risks  in  military  effectiveness.  They  generally  must 
be  made  against  a  backdrop  of  world  uncertainty  and  rapid  change. 
Often  even  very  small  improvements  gained  may  represent  substantial 
sums  of  defense  dollars. 

While  gross  errors  in  decision  logic  are  usually  caught  by 
the  intuit ive-huerlstlc  methods  now  inculcated  in  our  defense  and 
industry  management  at  all  levels,  it  remains  for  improvements 
in  new  scientific  management  techniques  and  new  information 
systems  to  detect  and  perhaps  eventually  correct  or  prevent  some 
of  the  more  subtle  errors  in  judgment.  In  my  opinion,  the  sum 
of  these  small  Improvements  toward  increasing  our  overall  pro¬ 
ductivity  may  eventually  mean  the  difference  between  "burying” 
the  enemy  and  in  being  "buried." 

I  have  been  asked  to  discuss  with  you  today  the  experiences 
we  have  gained  from  the  efforts  of  a  joint  DOD- Indus try  task 
group  organized  recently  to  study  cost-effectiveness  and  other 
similar  techniques.  The  primary  objective  of  the  study  was  to 
enhance  implementation  of  DOD  Directive  4100.35  which  requires 
the  "Development  of  Integrated  Logistics  Support  for  Systems 

and  Equipment. "  In  ay  presentation,  I  will  cover  three  (3) 
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principal  areas  -  First ,  a  bit  of  background  leading  up  to  the 
study;  Second,  the  "Modus  Operandi"  employed  by  the  study  group; 
and  lastly ,  a  brief  discussion  of  the  findings  and  conclusions 
of  the  group  to  date.  Z  should  like  to  point  out  that  the  study 
is  in  its  final  phases  and  any  recommendations  I  may  suggest  will 
only  be  tentative  at  this  point. 

The  background  for  the  task  group  efforts  began  in  June  of 
1964  when  OSD  issued  DOD  Directive  4100.35.  This  directive 
requested  each  of  the  Military  Departments  and  appropriate  defense 
agencies  to  develop  integrated  logistics  procedures  in  support 
of  systems  and  equipment.  The  directive  placed  emphasis  bn  two 
principal  concepts  -  One ,  that  the  plans  for  employment  of  a 
new  system  must  be  in-balance  with  the  plans  for  its  support;  and 
two ,  that  the  logistics  implications  of  that  system  must  be  con¬ 
sidered  at  the  earliest  possible  time  in  its  life  cycle  and  be 
integrated  as  one  of  the  principal  elements  of  trade-off,  along 
with  the  implications  of  research,  development  and  test.  These 
concepts  may  almost  sound  like  truisms,  but  let  me  say  we  are  not 
talking  about  integrating  one  plan,  we  are  talking  of  literally 
dozens  of  functional  plans  and  many  hundreds  of  variables. 

In  late  July  of  1964,  the  DUD  Maintenance  and  Equipment 
Council,  composed  of  the  senior  military  and  civilian  logisti¬ 
cians  of  the  Defense  Department  and  their  supporting  Ad  Hoc  Com¬ 
mittee,  assigned  nine  (9)  specific  development  tasks  to  the 
Military  Depat  ents  and  to  the  Logistics  Management  Institute. 

The  intent  was  to  more  rapidly  attain  the  objectives  assigned 
in  the  DOD  Directive.  These  tasks  required  a  review  of  the 


various  management  systems  sod  procedures  employed  by  defense 
contractors  and  the  DOD  to  conceive,  Introduce  and  support  a 
new  system  through  each  of  its  life  cycle  phases.  Two  things 
were  obvious  to  the  DOD  at  this  time.  One ,  that  the  Bcope  of 
the  problem  was  such  that  new  proposals  must  include  the  close 
cooperation  of  defense  contractors,  thus  the  National  Security 
Industrial  Association  was  solicited  as  a  team  member,  and 
two,  that  the  principal  objectives  of  integrated  logistics 
support  could  not  be  fully  attained  without  exploring  the 
possible  use  of  new  scientific  management  tools  and  techniques. 
This  latter  requirement  resulted  in  the  study  I  will  discuss 
with  you  today  known  as  DOD  Task  6. 

The  Air  Force  was  assigned  Task  6  in  September  of  1964. 

The  task  statement  read  "Develop  a  knowledge  of  current  and  pro¬ 
posed  cost-effectiveness  and  similar  scientific  management 
techniques  and  evaluate  their  suitability  for  conducting 
trade  off's  among  the  elements  of  logistics  and  between  the 
plan  for  use  and  the  plan  for  support. 

In  November ,  I  was  asked  to  chair  the  joint  study  group 
organized  to  accomplish  the  task.  It  included  representatives 
from  the  Army,  Navy,  Air  Force,  Defense  Supply  Agency  and  the 
National  Security  Industrial  Association.  The  immediate  objec¬ 
tives  established  by  the  group  were:  One,  to  survey  the 
"state  of  the  art"  of  techniques  in  Industry  and  Government; 
two,  to  evaluate  those  available  for  possible  support  of  DOD 
Directive  4100.35;  three ,  to  disseminate  the  knowledge  of 
these  techniques  to  logistics  managers  and  researchers  in 
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Defense  and  Industry;  and  fourth,  should  time  permit,  to  recommend 
additional  research  efforts  required.  It  was  recognized  that  by 
the  IS  June  65  deadline  set  for  study  completion  only  a  1st  step 
toward  these  lofty  goals  could  be  attained  and  some  tasks  must 
be  identified  for  follow-on  efforts. 

The  first  Important  questions  the  task  group  faced  were  what 
is  a  technique  and  how  could  we  identify  those  of  value?  In  this 
regard,  we  felt  we  must  be  decision-oriented,  that  is,  we  must 
start  with  a  specific  decision  performed  and  find  that  family  of 
tools  and  techniques  which  would  directly  support  or  improve  its 
accomplishment.  Thus,  the  principal  criteria  we  applied  to 
determine  if  a  technique  existed  was  "that  it  must  provide  an 
aid  in  the  evaluation  of  alternative  decisions,  assist  in  deter¬ 
mining  alternatives  or  Improve  confidence  in  decisions  made  or 
to  be  made."  In  all  cases,  the  technique  must  be  oriented  to  a 
worthwhile  systems  or  logistics  decision.  Management  systems, 
such  as  the  maintenance  management  systems  of  the  Services ,  were 
excluded  as  not  meeting  the  criteria. 

The  "Modus  Operandl"  approved  by  the  group  was:  First ,  to 
contact  both  DOD  and  Industry  organisations  likely  to  be  develop¬ 
ing  or  applying  mathematical  analysis  techniques  to  defense 
logistics  problems;  two,  to  meet  in  joint  sessions  monthly  and 
evaluate  for  usability  the  techniques  received;  three ,  to  prepare 
or  have  prepared  an  abstract  of  each  technique;  and  four ,  to 
develop  a  specialised  DOD  techniques  bibliography  and  distribute 
it  to  all  potential  users. 
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Approximately  100  techniques  or  applications  were  initially 
received  as  the  result  of  a  questionnaire  prepared  and  distri¬ 
buted  for  this  purpose.  This  became  the  basis  for  ovr  further 
inquiry  and  the  development  of  the  bibliographic  abstracts  and 
techniques  library  we  are  now  compiling.  We  recognized  that 
some  organizations  would  not  be  contacted  initially  who  may  have 
new  techniques  available,  but  our  intent  has  been  to  include  these 
as  a  follow-on  effort.  In  this  regard,  we  have  contacted  only  a 
few  sources  in  the  educations'1.  community.  We  have  screened  over 
150  techniques  thus  far  and  have  a  current  approved  library  of 
65.  Many  received  were  duplicates  or  studies  only  and  others 
did  not  meet  our  criteria.  Approximately  one-half  of  those 
received  ay  be  considered  as  including  a  cost/effectiveness 
trade-off . 

I  will  now  move  to  the  principal  findings  and  conclusions 
the  group  has  made  to  date  and,  where  appropriate,  I  will  also 
provide  you  with  our  tentative  recommendations. 

1.  We  found  that  most  available  mathematical  models  are 
special  purpose  in  nature  in  that  they  have  been  designed  to 
solve  an  Individual  problem  under  a  specific  set  of  conditions. 

We  found  that  they  derive  from  a  small,  well-established  set  of 
generalized  theories,  such  as  queing,  theory  of  games,  etc. 

They  have  not  been  sufficiently  generalized  to  be  promptly 
applied  by  another  user  without  considerable  modification. 
Sometimes  this  is  caused  by  a  model  having  been  programmed 
using  the  less  commonly  used  machine  languages,  utility  routines 
and  electronic  computers.  The  result  is  that  generally  another 
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user  obtains  the  technique  merely  to  extract  the  concept  and 
theories  employed  and  then  proceeds  to  construct  another 
special  purpose  technique. 

2.  As  a  corollary,  we  found  that  there  are  fow  generalized 
models  available  to  the  user.  Generally,  our  research  and 
development  of  new  mathematical  models  has  gone  from  the 
generalized  theory  to  a  specific  application.  It  may  now  be 
appropriate  to  apply  the  case  method  and  go  from  the  several 
growing  specialized  models  to  the  more  generalized  model  capable 
of  covering  a  wider  range  of  application. 

3.  We  found  that  generalized  models,  particularly  the  more 
sophisticated  man-machine  simulation  models  based  on  the 
mathematical  and  computer  sciences,  generally  require  long 
lead  times  to  construct ,  require  considerable  talent  to  con¬ 
ceive  and  may  be  very  costly.  But,  when  completed,  they  are 
more  effective  and  have  more  chance  of  survival  in  our  present 
world  of  variability  and  uncertainty. 

4.  We  found  a  rich  potential  source  of  available  techniques 
to  be  defense  and  Industry  studies.  But  we  also  found  that  to 
identify  and  extract  them  from  the  verbiage  will  require  con¬ 
siderable  time  and  effort.  This  we  plan  to  recommend  ae  a  follow- 
on  task. 

5.  We  found  that  many  techniques  were  not  sufficiently 
documented  to  permit  an  early  application  by  another  user.  In 
some  cases,  only  briefings  srs  available.  We  are  recommending 
additional  emphasis  be  placed  on  thle  important  phase  of  sharing 
our  knowledge.  Any  who  have  experienced  an  application  of  a  large 
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complex  problem  to  an  electronic  digital  computer  are  aware  that 
you  seldom  have  time  to  document,  but  you  can't  afford  not  to. 

6.  Somewhat  surprisingly,  we  found  that  proprietary  rights 
was  not  a  barrier  to  the  free  interchange  of  information.  In 
fact,  by  using  a  well -documented  abstract,  we  feel  it  will  help 
consulting  organisations  and  individuals  selling  their  services 
by  making  known  their  capabilities. 

7.  We  found  that  many  available  techniques  do  not  provide 
adequate  proof  of  validation.  Adequate  standards,  measures  and 
test  procedures  are  not  readily  available  and  being  considered 
as  a  necessary  adjunct  to  the  application  of  new  techniques. 

This  tends  to  continue  the  resistance  of  managers  and  operating 
personnel  toward  applying  new  methodologies.  We  consider  this 

a  viral  missing  link  in  the  communication  between  the  techniques 
Innovator  and  the  manager  on  whose  shoulders  the  burden  of  deci¬ 
sion  rests.  Our  recommendations  will  be  that  we  try  to  remove 
some  of  the  aura  of  mystery  from  mathematical  models  for  the 
manager  and  to  develop  more  readily  understood  procedures  for 
implementat ion . 

8.  We  found  that  much  effort  has  been  spent  in  both  defense 
and  industry  organizations  toward  developing  "pert"  type  charts 
which  isolate  a  series  of  events  occurring  in  the  life  cycle 

of  defense  systems  and  equipment,  but  that  little  research  has 
been  conducted  regarding  the  nature  of  the  decisions  associated 
with  these  events.  One  of  our  recommendations  will  center  on 
proposing  additional  research  in  this  area.  Selection  and  use 
of  the  proper  techniques  from  our  DOD  Library  will  be  largely 

dependent  on  such  a  precise  knowledge. 
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9.  We  found  that  the  detailed  knowledge  to  originate,  select 
and  apply  new  mathematically-oriented  techniques  Was  limited  to 
small  specialized  groups  in  defense  and  industry  and  seldom  was 
there  any  such  talent  in  the  middle-managers  own  functional 
organization.  This  capability  was  centered  in  operations  research, 
industrial  engineering,  systems  analysis  and  similar  small  research 
groups . 

10.  We  considered  education  and  training  and  not  reorganization 
as  the  proper  approach  to  bringing  the  manager  and  the  researcher 
closer  together.  It  does  not  appear  feasible  to  expect  a  mass 
educational  program  to  provide  the  manager  with  a  detailed  know¬ 
ledge  of  how  to  construct,  select  and  apply  sophisticated  mathe¬ 
matical  models .  Rather,  such  detailed  knowledge  should  continue 
to  be  vested  in  small  research  and  analysis  groups  who  work  as 
full-fledged  members  of  the  management  team.  But  we  do  recommend 
that  logisticians  in  key  middle  management  positions  be  trained 
to  recognize  the  latest  types  of  techniques  available  and  their 
limitations  and  capabilities  in  the  decision-making  process. 

Also,  top  management  should  be  fully  oriented  to  their  availability 
and  to  have  confidence  in  the  application  after  a  proper  valida¬ 
tion. 

In  addition,  we  will  probably  recommend  the  following: 

1.  That  a  single  DOD  agency  provide  bibliographic  services 
for  techniques  to  all  users  from  a  single  Data  Bank.  (Logistics, 
Research,  Production,  etc.) 

2.  That  OSD  emphasize,  encourage  and  guide  development  and 
implementation  of  generalised  models  on  a  broader  base  within  each 
service  and  agency. 
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3.  That  OSD  (ILL)  expand  the  DOD  logistics  bibliography  of 
techniques  and  to  emphasize  new  techniques  development. 

4.  The  follow-on  tasks  be  conducted  to  more  fully  evaluate 
the  capabilities  and  limitations  of  the  techniques  received  by 
the  study  group,  expand  the  search  for  new  techniques  and  main¬ 
tain  a  high  currency  and  responsiveness  of  the  bibliography  for 
the  user.  The  time  allotted  for  completion  of  the  study  did  not 
permit  an  accomplishment  of  these  tasks. 

The  Task  6  group  activities  have  been  extended  to  IS  July 
1965  and  follow-on  tasks  and  additional  proposals  are  now  in  the 
process  of  formulation. 

I  would  like  tc  point  out  that  the  group  considers  their 
present  study  only  a  first  step  toward  attaining  the  desired 
DOD  objectives.  I  hope- 1  have  portrayed  to  you  the  scope  of 
the  study  and  the  principal  findings  and  conclusions  of  the  DOD 
task  group.  I  should  now  like  to  close  on  an  optimistic  note  - 
"The  combination  of  new  mathematical  models  to  support  the  decision 
maker,  coupled  aith  the  latest  improvements  in  the  computer 
sciences,  may  well  provide  us  with  a  productivity  for  management 
unparallelled  in  our  history.  In  the  DOD,  we  must  stay  abreast 
of  this  tide." 
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SUJWARY  AND  EVALUATION  OF  RECENT  WORK  IN 
MEASURING  THE  PRODUCTIVITY  CF  FEDERAL  AGENCIES 

John  W.  Kendrick 


Productivity  indexes  have  long  been  a  tool  of  economists  for  measuring 
changes  in  productive  efficiency  in  the  national  economy  and  its  various 
industrial  branches,  and  their  impact  on  economic  aggregates  and  structure. 
Historical  measures  have  provided  perspective  for  projections  of  aggregate 
production  and/or  input  requirements  and  costs  by  industry.  The  measures 
can  also  be  used  for  comparing  productivity  of  like  producing  complexes 
at  a  point  in  time,  but  in  this  paper  our  focus  will  be  on  temporal 
comparisons . 

Since  World  War  II,  increasing  use  has  been  made  of  productivity 
me-.surement  as  a  management  tool  in-  the  business  firm.  Beginning  in  1962, 
the  Office  of  Management  and  Organization  in  the  Bureau  of  the  Budget  has 
been  encouraging  Federal  Government  Agencies  to  experiment  with  the 
preparation  and  use  cf  productivity  measures.  An  initial  set  of  pilot 
studies  was  undertaken  In  cooperation -with  representatives  of  $  agencies, 
the  results  of  which  were  reported  last  fall  in  Measuring  Productivity  of 
Federal  Government  Organization  (Washington:  U.S.  Government  Printing- 
Office,  19&U).  Since  that  time,  the  productivity  measurement  group  in 
the  Bureau  of  the  Budget  has  been  exploring  possibilities  of  meaningful 
productivity  measures  with  approximately  10  additional  agencies.  As 
6oon  as  staffs  in  those  agencies  are  assembled  (in  the  near  future) 
another  round  of  productivity  studies  will  be  launched  with  a  formal 
2 -week  training  cource  for  the  Agency  staffs,  which  proved  successful  the 
first  time. 

So  far,  all  of  the  Agencies  that  have  participated  in  the  Budget  Bureau 
productivity  measurement  program  have  been  civilian  in  character.  But  as 
I  describe  the  completed  studies,  you  will  probably  see  areas  of  possible 
applicability  to  Department  of  Defense  programs,  particularly  in  the  field 
of  logistics. 


The  Nature  and  Meaning  of  Productivity  Indexes 

It  is  important  at  the  outset  to  have  a  clear  idea  of  what  productivity 
measures  are  and  are  not,  and  hence  what  they  can  and  cannot  do.  Basically, 
productivity  indexes  measure  the  changes  (or  differences)  in  the  relationship 
of  output  to  input  of  a  producing  unit,  in  real  terms;  or,  conversely, 
the  changes  in  real  costs  per  unit  of  output  through  time.  By  "real,"  we 


*For  a  brief  history  of  productivity  measurement,  see  John  W.  Kendrick, 
Productivity  Trends  in  the  United  States,  Chapter  1.  (Princeton  University 
Press  for  the  National  Bureau  of  Economic  Research,  19ol). 

%ee  J.  W.  Kendrick  and  D.  Creamer,  Measuring  Company  Productivity: 
Handbook  With  Case  Studies  (National  Industrial  Conference  Board,  1961) . 
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mean  physical  units,  aggregated  by  means  of  unit  cost  weights,  held  con¬ 
stant  as  of  a  selected  base  period.  If  outputs  are  related  to  all  associated 
cost  elements,  or  inputs,  changes  in  the  output-input  ratio  reflect 
primarily  changes  in  the  technology  or  organization  of  production  as  a 
result  of  innovations,  and,  over  short  periods,  changes  in  rates  of 
utilization  of  productive  capacity  and  rates  of  adaptation  to,  or 
learning  of,  new  ways  and  means  of  production. 

By  thus  measuring  the  economics  achieved  through  time  in  utilization 
of  costly  resources  per  unit  of  output,  productivity  indexes  are  one  guage 
of  management  efficiency  in  its  most  characteristic  function  —  innovation, 
Including  the  adaptation  of  the  organization  to  technological  changes. 

Productivity  indexes  do  not  indicate  whether  the  selection  and 
combination  of  outputs  are  optimal tdth  respect  to  the  objectives  of  an 
organization  --  which  may  be  long-run  profit  maximization  in  the  case  of 
the  private  firm,  or  fulfillment  of  the  assigned  mission  in  the  case  of 
public  agencies.  Neither  do  productivity- indexes  reveal  whether  the 
inputs  represent  a  least-cost  combination,  given  prevailing  relative  in¬ 
put  pricies  end  the  technological  possibilities.  The  indexes  merely 
meas'ire  the  ret  savings  in  real  costs  achieved  in  production  of  given 
outputs  in  ijcs-sive  time  periods.  In  specifying  the  relevant  output 
and  input  units,  ho --ever,  productivity  measurement  systems  make  possible 
unit  cost  estimates  for  the  full  range  of  relevant  outputB  and  inputB 
required  for  optimizing  decision-making. 

The  productivity  Indexes  also  do  not  measure  changes  in  productive 
efficiency  relative  to  some  "norm,"  as  in  the  case  of  work  measurement. 

The  latter  systems  measure  actual  time  required  per  unit  of  work  in 
the  various  operations  in  relation  to  statistically -determined,  or 
engineered,  norms.  When  major  changes  in  equipment  or  organization  are 
made,  the  norms  are  changed,  so  that  the  measures  are  discontinuous.  In 
contrast,  productivity  systems  attempt  to  measure  the  units  of  final 
output  (not  all  types  of  work  units)  of  the  organization  continuously 
through  time  adjusting  where  necessary  and  feasible  for  quality  charge; 
the  weights  are  not  "norms"  but  merely  unit  costs  of  a  base -period;  by 
comparing  aggregate  output  with  similarly  weighted  inputs,  the  results 
of  the  cost-reducing  technological  changes  are  revealed. 

Finally,  while  productivity  measures  may  concentrate  on  labor  time 
alone,  in  order  to  show  changes  in  unit  manhour  usage  (or  its  inverse, 

"output  per  manhour" ),  more  comprehensive  measures  relating  to  all 
inputs,  or  cost  elements*  are  more  desirable.  The  total  productivity 
ratios  make  possible  the  calculation  of  the  effects  of  factor  substitutions 
on  individual  input  requirements,  as  well  as  showing  the  net  economies 
in  real  costs  achieved  over  time. 
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Components  of  the  Productivity  Measures 

To  really  understand  the  significance  and  potential  uses  of  productivity 
measures,  it  is  necessary  to  understand  just  how  the  output  and  input  compo¬ 
nents  of  the  measures  are  defined  and  constructed.  We  shall  describe  each 
of  these  first  in  general  terms,  then  illustrate  concretely  from  the 
Budget  Bureau  case  studies. 

Output 

To  be  susceptible  to  productivity  measurement,  an  organization  must 
produce  relatively  standard  types  of  outputs  from  one  period  to  the  next. 
Numbers  of  units  produced  must  be  counted  in  terms  of  the  smallest, 
homogeneous  type  of  commodity  or  service  rendered.  Popular  opinion  to 
the  contrary,  it  is  as  easy  to  define  and  measure  typeB  of  services  as 
it  is  commodity -types .  In  the  case  of  General  Government,  however,  the 
alternative  to  weighting  physical  units  --  the  "deflation"  of  production 
values  to  correct  for  price  changes  —  is  not  available  since  Government 
services  are  not  priced  and  sold  on  markets  as  is  private  industry  out¬ 
put.  This  restriction  does  not  generally  apply  to  inputs,  however.  For¬ 
tunately,  the  development  of  work  measurement  systems  and  other  performance 
measures  has  proceeded  far  enough  in  most  Federal  agencies  to  provide 
most  or  all  of  the  required  physical  volume  of  service  output  data  for 
productivity  measurement.  Cost  accounting  systems  generally  provide  the 
data  required  to  weighting  units  of  the  various  types  of  outputs  (and 
inputs). 

When,  as  frequently  occurs  in  a  dynamic  economy  from  time-to-time, 
the  "quality"  or  resource  content  of  the  output  changes,  an  adjustment 
to  the  succeeding  output  units  should  be  made  to  preserve  comparability 
with  the  older  model  products. 

It  is  also  important  that  only  final  -products  be  measured.  These 
are  the  goods  or  services  which  implement  the  basic  mission  of  the  agency 
in  servicing  the  public  or  other  agencies.  Staff  services,  such  as  per¬ 
sonnel  administration,  custodial  and  Internal  maintenance  services,  which 
are  "intermediate"  and  merely  facilitate  performance  of  basic  missions, 
should  be  excluded.  In  this  respect,  the  scope  of  productivity  and  work 
measurement  systems  differ .  Increasing  efficiencies  in  intermediate 
production  indirectly  affect  productivity  indexes;  they  could  be  shown 
explicitly  though  the  ratio  of  intermediate  to  final  work  units  based  on 
work  measurement  data. 

The  more  consolidated  government  organization  productivity  indexes 
are  made,  the  more  outputs  are  excluded  as  intermediate.  In  the  Department 
of  Defense,  it  would  be  very  difficult  to  define  and  measure  the  final 
services  of  the  entire  Department  to  the  public.  It  is  much  easier  to 
define  and  measure  various  logistical  and  other  support  services;  which 
suggests  that  DOD  organizational  productivity  measures  would  better 
remain  unconsolidated  unless  the  problem  of  measuring  final  defense 
services  is  solved. 
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Although  intermediate  outputs  are  excluded,  the  production  of  invest¬ 
ment  outputs  should  be  included.  These  outputs,  which  may  be  consumed  with¬ 
in  the  organization  but  only  over  a  number  of  accounting  periods,  them¬ 
selves  render  input  services  over  their  lifetimes. 

So  much  for  general  observations.  Let  us  now  see  how  the  several 
agencies  included  in  the  Budget  Bureau  pilot  studies  defined  their 
final  outputs. 

Division  of  Disbursement  —  The  simplest  set  of  outputs  of  all  those 
studied  was  provided  by  the  Division  of  Disbursement  in  the  Treasury 
Department.  Only  two  separate  outputs  were  defined:  the  number  of  pay¬ 
ments  made  on  behalf  of  other  Government  agencies,  and  the  number  of 
savings  bonds  issued  to  payroll  plan  savings  bond  subscribers.  The  pay¬ 
ments  were  of  various  types,  such  as  payments  of  veterans  benefits  and 
NS LI  dividends,  social  security  benefits,  tax  refunds,  and  salary  pay¬ 
ments  by  tne  various  agencies  —  but  no  differentiation  was  made  since 
the  payment  unit  was  relatively  homogeneous  regardless  of  object. 

Very  significant  subsidiary  data  were  available,  however,  showing 
numbers  of  payments  by  method  (see  Table  1).  Since  the  corresponding  in¬ 
put  data  were  also  available,  it  was  possible  to  compute  productivity  by 
level  of  technology. 


TABLE  1 


Division  of  Disbursement:  Number  of  Savings  Bonds  Issued, 
Cash  Payments,  and  Checks  Issued  by  Method  of  Preparation 
_ (Selected  years;  in  thousands) _ 


- Fiscal  Years — 

1956 

1962 

Savings  bonds  issued 

2,486 

2,854 

3,999 

Cash  payments 

Checks  issued  (by  method) 

664 

0 

0 

Typed 

51,204 

15,900 

12,984 

Addressing  machine 

129,921 

163,700 

8,837 

Manual  transfer  ported 

13,823 

8,171 

0 

Bill  feed 

0 

14,249 

107,199 

Automatic  transfer  ported 

0 

2,094 

0 

Thermal  printed 

0 

19,560 

3,029 

Semi -electronic 

0 

0 

67,9^1 

Stencil 

0 

0 

3,552 

EDP 

0 

0 

114,120 

TOTAL 

198,098 

226,528 

321,661 

Source:  Measuring  Productivity  of  Federal  Government  Organizations.  Table  21, 
p.  108.  Annual  data  are  shown  in  -he  original  table.  ~ 
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Department  of  Insurance ,  VA.  —  The  Insurance  Service  of  the  Veterans 
Administration  is  engaged  in  providing  life  insurance  coverage  with  all 
of  the  services  provided  by  law.  The  services  were  defined  as  consisting 
of  5  main  types:  (l)  the  basic  service  is  provision  of  insurance  protection, 
as  reflected  in  the  average  nuaiber  of  policies  in  force  during  successive 
periods;  (2)  a  distinct  service  is  the  waiver  of  premium  payments  in  caaes 
where  the  insured  become  totally  disabled,  as  measured  by  the  number  of 
Initial  claims  and  the  number  of  review  decisions;  (3)  tennination  service 
consists  of  making  final  settlements,  but  costs  differ  according  to  the 
several  ways  the  insurance  policy  is  terminated:  ( 4 )  the  number  of  loan 
applications  measures  the  service  of  lending  to  policyholders  against 
accumulated  equity;  (5)  a  fifth  category  consisted  of  the  numbers  of  new 
policies  issued  (two  types).  The  volume  of  the  several  types  of  output 
for  selected  years  is  shown  in  Table  2. 

TABLE  2 

VA  Department  of  Insurance:  Volume  of  Outputs,  by  Type 
(Selected  years;  in  thousands) 


1955 

1959 

1962 

Average  number  of 
policies  in  force 

6,46 9 

6,439 

6,052 

New  policies  issued 

("service  disabled"  and 
"other") 

212 

6 

4 

Selected  terminations: 

Death 

20 

23 

27 

Lapse 

335 

63 

91 

Cash  surrended  and  matured 
endowment 

30 

15 

15 

Disability  claims: 

New  claims 

29 

18 

20 

Review  decisions 

65 

53 

58 

Loan  applications 

97 

106 

ll6 

Source:  Measuring  Productivity 

of  Federal 

Government 

Organizations,  Table 
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Although  the  Department  of  Insurance  computed  an  output  Index  based 
on  all  9  major  types  of  output,  It  relied  principally  on  a  5-output  In¬ 
dex  for  reasons  of  simplicity.  Both  types  of  policy  Issue  vere  of 
negligible  Importance  in  recent  years,  and  vere  omitted;  and  only  one 
lapse  series,  instead  of  three,  was  used. 

Boat  Office  Department  —  The  final  outputs  of  the  Post  Office 
Department  vere  defined  In  terms  of  14  classes  of  mail,  and  7  types  of 
services  (see  Sable  3).  The  multiple  physical  volume  measures  shown  for 
second-  and  fourth-class  mall  Improve  the  homogeneity  of  the  weighted 
aggregates  without  involving  duplication  since  the  weights  for  these 
classes  of  man  are  split  among  the  measures  of  the  several  dimensions 
of  output.  The  measures  shown  In  the  table  cover  about  98  percent  of 
total  Post  Office  product.  Box  rentals  and  various  non-postal  services, 
such  as  alien  address  reporting,  vere  omitted. 

Am  interesting  aspect  of  the  Post  Office  study  was  the  derivation 
of  c  oeponent  output  indexes  for  the  following  broad  areas  of  total  man¬ 
power:  (A)  mallhandling,  window  service  and  related  maintenance; 

(B)  collection  and  delivery  service,  and  related  maintenance;  and  (C) 
administration  and  related  field  services.  The  same  outputs  vere  used, 
but  weights  vere  split  by  component  manpower  usage. 

Weighted  output  Indexes  (based  on  allocations  of  total  costs)  vere 
also  computed  for  the  following  segments:  (I)  personnel  costs;  (U) 
purchased  nonlocal  transportation  service;  and  (ill)  building  occupancy 
(rent).  These  segmental  and  associated  productivity  measures  are  help¬ 
ful  In  quantifying  the  contributions  of  the  -various  parts  of  the  De¬ 
partment  to  productivity  change. 

Systems  Maintenance  Service.  FAA. —  The  product  of  the  Systems 
Maintenance  Service  of  the  Federal  Aviation  Agency  is  defined  as  "a 
facility  in  operation.”  The  measure  involves  both  the  number  of  facilities 
maintained,  by  type,  and.  the  period  of  time  over  which  they  are  maintained 
In  operational  condition.  The  various  types  of  facilities  are  weighted 
by  their  base-period  (FT  1962)  labor  maintenance  costs.  If  the  weighted 
aggregate  is  divided  by  the  average  annual  labor  cost  of  1 962,  a  common 
denominator  of  output,  the  "Standard  Facility  Year”  is  derived. 

3he  various  major  types  of  facilities,  and  the  associated  Standard 
Facility  Years,  are  shown  for  selected  years  in  Table  4.  Actually, 

Group  1,  Air  Navigation  Outputs,  includes  out  juts  for  23  different 
facility  types,  subdivided  Into  56  classes  and  subclasses.  Group  II, 

Air  Traffic  Control  Outputs,  includes  outputs  of  44  facility  types, 
subdivided  into  211  classes  and  subclasses;  and  Group  HI,  Nonaero- 
nauticai  Outputs,  Include  outputs  of  1 6  facility  types,  subdivided 
Into  51  classes  and  subclasses.  Thus,  the  three  Groups  together  comprise 
83  facility  types,  and  318  classes  and  subclasses. 

An  Interesting  feature  0f  the  Systems  Maintenance  Service  study 
was  the  preparation  of  separate  output  and  productivity  Indexes  for  the 
6  FAA  regions.  A  useful  quality  indicator,  facility  outages,  was  prepared 
by  cause  of  outage  time,  by  region. 
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TABLE  3 


Post  Office  Department,  Quantities  of  Output  toy  Class 
Of  Mail  and  Service,  F5f  1953,  1958,  and  1962 
(In  millions) 


Clast:  of  nail  and  service 

Measure 

1962 

1958 

1953 

ist-class  mall 

t*leces 

”35,332 

32,218 

27,2$7 

Domestic  airmail,  letters 

do 

1,513 

1,410 

1,412 

and  cards. 

Domestic  airmail,  parcels 

do 

32 

24 

13 

Pieces 

8,090 

7,148 

6,762 

2d-class  mall 

Pounds 

2,908 

2,695 

2,497 

Cubic  feet 

133 

127 

115 

Controlled  circulation  pub- 

Piece  8 

165 

145 

56 

llcations . 

3d -class  mall 

do 

17,837 

16,064 

12,210 

4th -class  mail— "books" 

Pieces 

153 

93 

68 

(educational  and  library 

Rounds 

636 

446 

300 

materials) 

Cubic  feet 

35 

23 

15 

Pieces 

871 

862 

97C 

Other  4th -class  mail 

Pounds 

4,938 

5,254 

6,197 

Cubic  feet 

508 

534 

54l 

International  surface  mall 

Pieces 

287 

353 

336 

International  airmail,  letters 

do 

218 

181 

148 

and  cards 

International  airmail,  parcels 

do 

1.3 

0.98  0.86 

Penalty  mall 

do 

1,877 

1,560 

1,658 

Franked  mail 

do 

111 

67 

49 

Free -for -blind  mail 

do 

6 

4.1 

2.7 

Registry  service 

Items 

55 

57 

90 

Certified  mall  service 

do 

31 

24 

0 

Insurance  service 

do 

165 

158 

198 

Collect-on -deli very  service 

do 

24 

29 

49 

Special  delivery  service 

do 

92 

96 

114 

Money  order  service 

Money  orders 

252 

312 

370 

Postal  savings  service 

Certificates 

2.7 

6.1 

20 

Source:  Measuring  Productivity  of  federal  Government  Organizations ,  Table  45, 
pp.  206 -209.  Appendix  VI-l^or  a  complete  listing  of  all  types  and 
classes  of  facilities. 
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TABLE  4 


SYSTEMS  MAINTENANCE  SERVICE,  GROWTH  OF  OUTPUT 
by  Major  Type  of  Facilities,  1958-62 


Standard  facility  years 

FY  1958  FY  1962  Increase 

Air  navigation: 

Percent 

VHF  omnidirectional  facilities 

403.12 

610.53 

51.5 

TACAN  and  distance  measuring 

123.31 

592.49 

380.5 

equipment 

Low-frequency  ranges  and  fan  markers  294.71 

262.26 

-11.0 

Homing  beacons 

59.32 

68.72 

14.9 

Instrument  landing  systems 

285.06 

374.67 

31.4 

Approach  light  systems 

43.52 

187.32 

330.4 

Beacons  and  fields 

120.33 

60.50 

-49.9 

Group  I  —  subtotal 

1,330.37 

2,156.49 

SIT 

Air  Traffic  control: 

Towers,  stations,  and  centers 

1,709.27 

3,888.62 

127.5 

Radar  systems 

239.23 

884.37 

269.7 

VHF  and  microwave  links 

113-59 

481.35 

323.8 

Direction  finders 

31.26 

49.55 

58.5 

Teletypewriter  systems 

126.01 

206.81 

64.1 

Engine  generating  equipments 

52.34 

46.87 

-10.5 

Group  II  —  subtotal 

2,271.70 

5,557.57 

144.6 

Nonaeronautical : 

Housing,  utilities,  and  miscel- . 

laneous 

318.30 

386.21 

21.3 

Group  III  —  subtotal 

318.30 

386.21 

21.3 

Total 

3,920.37 

8,100.27 

106.6 

Source: Measuring  Productivity  of  Federal  Government  Organizations,  Table  58, 
p.  264,  See  Appendix  VI-1  for  a  con^lete  listing  of  all  types  and 
classes  of  facilities. 
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Bureau  of  Land  Management.  —  The  mission  of  the  Bureau  of  Land 
Management  In  the  Department  of  the  Interior  is,  generally  "...to  manage 
the  Federal  lands  under  its  Jurisdiction  according  to  the  best  conservation 
practices  and  to  make  available  the  land  and  resources  in  a  manner  con¬ 
sistent  with  the  public  interest  as  provided  by  law. "3  The  outputs  of 
the  Bureau  proved  difficult  to  define  in  operational  terms,  in  part  be¬ 
cause  its  end  products  consist  of  "investment"  outputs  representing  im¬ 
provements  in  resources  as  well  ns  of  "current"  outputs  consisting  of 
direct  services  to  Individuals  and  organizations.  In  part,  the  difficulties 
were  associated  with  a  variable  quality  content  of  the  outputs  as  measured. 
Due  to  these  difficulties,  and  lack  of  certain  strategic  data,  the  Bureau 
was  not  able  in  the  time  available  to  measure  investment  outputs,  and 
the  current  output  measures  which  were  developed  for  3  of  the  5  programs 
were  considered  to  be  interim  in  nature.  As  a  result,  no  composite 
agency  measure  was  possible  and  no  Bureau  productivity  measure  is  included 
in  summary  Table  6  below. 

The  five  major  programs  of  the  Bureau  are  shown  in  Table  5.  The 
manhours  allocated  to  current  outputs,  as  distinct  from  investment  out¬ 
puts,  are  based  on  programming  data.  No  output  measures  were  developed 
for  the  Range  and  Recreation  programs,  which  absorbed  a  bit  under  20  per¬ 
cent  of  manhours  devoted  to  current  output  in  FY  1962.  For  the  Lands 
and  Minerals  program,  measures  were  devised  based  on  number  of  cases 
closed  in  response  to  applications  by  the  public  for  leases,  grants  and 
sales  in  the  categories  listed  in  the  table.  An  alternative  measure  was 
based  on  positive  decisions  (issuances  nnd  allowances).  Since  the 
numbers  of  denials  rose  sharply  relative  to  positive  decisions  over  the 
period  1952-62,  the  alternative  measures  show  quite  different  results. 

A  weighted  aggregate  of  the  several  types  of  decisions  would  seem  to 
have  been  a  reasonable  compromise. 

In  the  Forestry  program,  the  measure  was  based  on  the  number  of 
broad  feet  of  timber  cut  and  the  amount  offered  for  sale.  A  decline 
in  this  composite  index  between  1952  and  1962  was  apparently  due  to 
Increased  manpower  requirements  for  constructing  access  routes,  for  classi¬ 
fying  timber  resources,  for  preparing  timber  tracts  for  sales,  super¬ 
vising  cutting,  and  for  administering  sales  contracts.  Ibis  suggests 
that  not  all  manhours  associated  with  investment  were  eliminated  from 
the  current  programs,  as  well  as  indicating  the  need  for  a  quality  ad¬ 
justment  factor  to  current  output. 

In  Cadastral  Surveys,  output  was  measured  by  the  number  of  miles 
of  line  surveyed  and  the  number  of  monuments  set  for  users  outside  the 
Bureau.  Sharp  fluctuation  in  this  index  suggest  that  more  research  is 
needed  to  allow  for  variations  in  local  conditions  and  other  qualitative 
factors  before  the  index  is  finalized. 


3lbid.,  p.  301 


TABUS  5 


Bureau  of  Land  Management,  Estimated  Distribution  of  Total1 
Manhours  Worked,  by  Program  and  Type  of  Output,  FY  1962 


Program  and  type  of  output 

Man-hours 
allocated 
to  current 
outputs 

Man-hours 
allocated 
to  invest¬ 
ment  outputs 

Lands  and  minerals  program  total 

1,803, 5^1 

681,731 

Agricultural  cases 

163,085 

n.a. 

Exchanges 

195,702 

n.a. 

Sales  of  land 

271,808 

n.a. 

Selections 

184,830 

n.a. 

Land  title  cases 

163,085 

n.a. 

Leases  and  permits  (land) 

108,723 

n.a. 

Mineral  entries 

179,077 

n.a. 

Oil  and  g&e  leases  (on  land) 

358,155 

n.a. 

Oil  and  gas  leases  (OCS2  ) 

71,631 

n.a. 

Material  sales 

35,815 

n.a. 

Leases,  permits,  licenses  (mineral) 

71,631 

n.a. 

Forestry  program  total 

664,589 

791,861 

Timber  offered  for  sale 

531,671 

ZlsfiLs 

Timber  cut 

132,918 

n.a. 

Cadastral  surveys  for  other  agencies 

total 

77,036 

0 

Miles  of  survey  line 

30,814 

0 

Monuments  set 

46,222 

0 

Range  program  total 

557,897 

1,156,053 

Recreation  program  total 

1,548 

6,19^ 

SLM  total 

3,104,612 

2,635,539 

n.a.  -  not  available. 

1  Excludes  10,036  man-hours  devoted  to  fighting  of  fires 

2  Outer  Continental  Shelf. 


Source:  Productivity  of  Federal  Oovep-^^t.  Table  65 
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TABLE  6 


ANNUAL  GAINS  IN  PRODUCTIVITY  OF  FOUR  FEDERAL  GOVERNMENT  ORGANIZATIONS 

(average  percent  per  year) 


Organization  and  period 

Output  per 
man-hour 

Output  per  con¬ 
stant  dollar  of 
payroll  cost 

Output  per  c< 
stant  dollar 
total  cost 

Average* 

Average* 

Average* 

Department  of  Insurance 
Veterans  Administration 
1555-62 

9.8 

8-3 

*6.9 

Division  of  Disbursement, 
Department  of  the  Treas¬ 
ury,  1949-62 

29.4 

8.6 

36.1 

Post  Office  Department , 
1953-62 

0.3 

0.2 

U0.4 

Systems  Maintenance  Serv¬ 
ice,  Federal  Aviation 
Agency,  1958-62 

-4.1 

.1 

n.a. 

*£erlod  averages  were  calculated  by  the  compound  interest  formula  (annually 
compounded)  applied  to  the  values  of  the  productivity  index  In  the  first 
and  the  last  year  of  the  period. 


a. a.  -  Not  available. 

1  Total  budget  cost. 

2  Output  per  man -year . 

3  Excludes  postage. 

^  Includes  personal  services,  transportation,  and  space  occupancy  costs. 


Source: 


Measuring  Productivity  of  Federal  Government  Organizations.  Table  1, 
p.l4. 
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Despite  the  lack  of  definitive  results,  apparently  the  interim  re¬ 
sults  have  been  of  some  use  to  Bureau  management  "...  In  that  the  process 
of  output  identification  contributed  to  clarification  of  goals  and 
objectives  and  outlined  needs  for  additional  information."4 

Input 8 

The  measure  of  resource  inputs,  or  cost  elements,  used  in  an  organization 
should  have  the  same  scope  as  the  output  measure.  Further,  as  we  noted 
earlier,  it  is  desirable  if  *1 1  inputs  are  measured  so  that-  net  savings 
in  total  real  budgeted  costs  per  unit  of  output  can  be  calculated.  All 
of  the  agencies  prepared  measures  of  the  predominant  labor  input,  and  3 
of  them  developed  measures  that  purported  to  cover  all,  or  most,  of  the 
budgeted  costs. 

The  first  measure  of  labor  input  was  based  on  employee  time.  Man¬ 
hours  worked  were  calculated  in  the  Department  of  Insurance,  the  Post 
Office,  and  the  Systems  Maintenance  Service.  In  the  other  two  agencies, 
full-time  equivalent  man-years  worked  were  calculated,  although  in  the 
Bureau  of  Land  Management  man-years  were  converted  into  estimated  man¬ 
hours  by  a  uniform  conversion  formula. 

A  more  refined  variant  of  the  labor  input  measure  was  computed  in 
four  of  the  agencies  (other  than  ELM).  Data  on  manhours  or  man-years 
worked  were  assembled  by  grade  (by  occupational  category  in  the  PoBt 
Office  case)  and  then  weighted  by  base-period  average  labor  compensation 
in  each  category.  This  technique  in  effect  adjusts  for  different  qualities 
of  labor.  If  there  were  a  relative  shift  of  labor  to  higher-paid  grades 
or  occupations,  the  "real  labor  cost"  index  would  rise  relative  tc  the 
labor-time  index.  This  was  generally  the  case,  except  for  the  Systems 
Maintenance  Service  in  which  there  was  an  average  downgrading  of  labor 
after  1958. 

Of  the  3  agencies  with  more  comprehensive  real  cost  measures,  the 
VA  Department  of  insurance  included  total  budgeted  costs;  the  Division 
of  Disbursement  included  all  budgeted  costs  except  postage;  while  in 
the  Post  Office  Department  transportation  and  building  occupancy  costs 
were  included  in  addition  to  payrolls.  The  nonlabor  costs.  Including 
equipment  rentals,  were  generally  "deflated"  by  more  or  less  appropriate 
price  indexes. 

No  allowance  was  made  for  an  implicit  interest  cost  and  depreciation 
on  capital  goods  commanded  by  the  agencies.  This  would  seem  to  be  a 
defect  in  the  total  real  cost  measures,  associated  in  part  with  deficiencies 
in  Federal  Government  cost  accounting  procedures.  Neither  was  a  real  coBt 
estimated  for  the  floor  space  and  utilities  furnished  free  of  charge  by 
the  General  Services  Administration.  Nor  were  real  charges  computed 
for  a  share  of  overhead  of  parent  agencies,  or  outside  service  agencies 
such  as  the  Civil  Service  Commission. 


4Ibid,,  p.  304. 
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While  there  are  advantages  in  sticking  to  real  budgeted  costs,  more 
comprehensive  analysis  of  productivity  change  would  require  computation 
of  alternative  indexes  based  on  all  inputs  utilized,  whether  explicitly- 
charged  to  the  agency  or  not. 

Weighting 

Fiscal  year  1962  was  chosen  as  the  base-period  for  output  and  inprut 
weights.  Theoretically,  relative  weights  car,  affect  the  movement  of  out¬ 
put  or  input  aggregates  and  thus  of  productivity  ratios.  Weighting 
experiements  with  the  Post  Office  measures  indicated  that  the  selection 
of  the  base-period,  from  the  available  pcst-War  years  made  relatively 
little  difference.  Nevertheless,  consistency  of  base-period  (and  other 
aqpects  of  methodology)  among  the  agencies  is  a  desirable  feature  of 
Budget  Bureau  leadership  in  the  productivity  studies. 5 

The  principle  of  symmetry  between  the  types  of  weights  used  to  com¬ 
bine  outputs  and  the  range  of  inputs  with  which  output  was  compared  was 
another  desirable  feature  of  the  agency  measures.  In  the  Division  of 
Disbursement,  for  example,  where  man-years,  constant  dollar  payrolls,  and 
total  real  costs  were  each  related  to  output,  the  individual  outputs 
were  combined  by  the  three  corresponding  sets  of  weights.  By  this 
procedure,  the  overall  productivity  index  is  an  internal  mean  of  its 
components,  and  remains  unaffected  by  relative  shifts  of  resources  from 
one  type  of  activity  to  another  within  the  organization. 

Results  of  the  Studies 

The  average  annual  rates  of  change  over  the  periods  covered  in 
the  several  types  of  productivity  measures  for  the  Federal  Government 
organizations  studied  are  summarized  in  Table  6.  There  was  considerable 
variability  in  the  annual  percent  changes,  as  is  also  true  of  private 
company  and  industry  measures. 

The  high  rate  of  productivity  advance  in  two  of  the  organizations, 
compared  with  the  rate  of  change  in  the  other  two,  is  striking.  The  high 
rates  compare  favorably  with  productivity  advance  in  the  most  dynamic 
private  industries  over  comparable  time-spans.  It  should  be  noted  that 
the  dispersion  of  rates  of  change  narrows  as  output  is  related  to  pro¬ 
gressively  broader  input  measures.  This  is  due  to  the  fact  that  the 
very  high  rates  of  gain  in  output  per  manhour  were  purchased  in  part  at 
the  cost  of  considerable  up-grading  of  labor,  and  significant  increases 
in  captial  and  other  inputs  per  enployee . 


5  Weighting  and  other  aspects  of  index  number  methodology  are  discussed 
in  detail  by  Bruce  D.  Mudget,  Index  Numbers  (John  Wiley  and  Sons,  1951) • 

See  also  the  classical  work  by  Wesley  C.  Mitchell,  The  Making  and  Using 
of  Index  Numbers,  Bulletin  656,  Bureau  cf  Labor  Statistics,  U.S.  Depart¬ 
ment  of  Labor. 


'90-595  0-65-6 
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The  Budget  Bureau  observes  due  caution  in  appending  the  following 
note  to  its  summary  Table:  "The  data  shown  in  this  table  do  not  warrant 
comparisons  of  management  effectiveness  in  individual  organizations  be¬ 
cause  these  estimates  of  actual  productivity  gains  realized  do  not  make 
any  allowance  for  possible  differences  in  the  potential  for  productivity 
improvements  that  existed  during  the  period."  Yet  one  wonders  if  there 
is  not  considerable  room  for  improvement  of  productivity  performance  in 
the  two  low  agencies.  Possible  management  uses  of  the  productivity 
indexes  as  a  tool  for  spurring  productivity  advance  and  other  purposes 
are  discussed  in  the  following  section. 

The  experience  of  four  markedly  different  organizations  is  admittedly 
a  narrow  basis  for  generalization.  Yet  the  report  points  cut  that  the 
organizations  with  rapid  productivity  advance  were  characterized  by 
(1)  radical  changes  in  production  technology;  (2)  uniform  (i.e.,  not 
diversified)  output;  and  (3)  a  comparatively  small  number  of  locations. 

In  constrast  to  experience  in  private  industry,  there  was  not  a  positive 
correlation  between  relative  increases  in  productivity  and  in  output, 
possibly  due  to  the  irrelevance  in  government  of  the  tendency  for  relative 
productivity  increases  to  be  associated  with  relative  price  declines  and 
relative  sales  advance. 

As  the  number  of  cases  in  the  budget  bureau  file  grow,  so  will  pos¬ 
sibilities  of  generalization  regarding  causes  of  increasing  productive 
efficiency.  This  type  of  analysis  will  also  be  promoted  by  detailed 
agency  descriptions  and  analyses  of  their  own  historical  records.  In 
the  Treasury  Department  case,  for  example,  not  only  are  the  technological 
developments  detailed,  but  an  interesting  attempt  is  made  to  estimate 
the  dollar  savings  resulting  from  the  major  types  of  managment  improve¬ 
ments.®  Broad  dissemination  by  the  Office  of  Management  and  Organization 
of  information  concerning  successful  cost  reducing  innovations  in  given 
agencies  to  all  agencies  could  be  significant  force  in  accelerating  the 
diffusion  of  innovation. 


Evaluation 


Methodology 

Technically,  I  believe  the  Federal  agency  productivity  measures 
are  constructed  according  to  sound  principles  (with  the  possible 
exception  of  the  treatment  of  capital  inputs),  and  compare  favorably  with 
Ihe  best  of  those  available  in  the  private  sector  of  the  economy.  Once 
the  basic  quantity  measures  are  done,  however,  more  effort  should  be  de¬ 
voted  to  devising  appropriate  measures  of  quality  change,  such  as  the  out- 


Ibid.,  Appendix  III-l,  p.  124,  It  should  also  be  noted  that  between 
1948  and  19®4,  approximately  half  of  the  regional  offices  of  the  Division 
of  Disbursement  had  been  closed(see  Appendix  III -2,  p.  125.) 
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age  index  developed  by  the  Systems  Maintenance  Service.  Quality  measures 
are  important  in  their  own  right,  as  well  as  aiding  the  interpretation  of 
productivity  indexes.  I  have  been  informed  that  the  Budget  Bureau  plans 
to  put  more  stress  on  quality  measures  in  their  second  round  of  productivity 
studies . 

It  should  also  be  pointed  out  that  once  estimation  methods  have  been 
worked  out,  the  Agency  cannot  then  proceed  to  continue  computing  the 
productivity  indexes  in  a  mechanical  way.  Continuing  "repair  and  main¬ 
tenance"  is  required,  particularly  to  identify  modifications  of  outputs, 
new  services  introduced  and  old  ones  dropped.  Consideration  should  be 
given  periodically  to  possible  changes  in  output  and  input  weights,  when 
relative  unit  costs  have  changed  significantly.  Whenever  possible, 
improvements  to  the  measures  should  be  made  when  new  data  (as  on  non-labor 
inputs)  become  available  or  are  developed  specially  for  the  productivity 
measures . 

Management  Use 

The  degree  of  usefulness  of  productivity  indexes  to  the  management 
officials  of  Government  agencies  remains  to  be  proved.  As  summary  measures, 
productivity  indexes  are  of  primary  interest  to  top  management  in  agencies 
and  their  organizational  divisions.  At  best,  they  merely  serve  to  sig¬ 
nal  the  need  for  investigation,  and  the  asking  of  further  questions.  A 
sluggish,  or  declining,  overall  index  is,  of  course,  cause  for  general 
concern.  The  components  of  the  index,  disaggregated  by  organizational 
units,  by  types  of  service,  and  by  types  of  input,  will  help  to  pinpoint 
a  typical  experience.  In  some  cases,  the  seemingly  unfavorable  behavior 
of  an  index  may  be  quite  explainable,  as  when  a  partial  productivity 
ratio  drops  as  a  result  of  substitution  of  the  measured  input  for  another 
input.  In  other  cases,  unfavorable  index  changes  may  lead  to  investigations 
that  uncover  inefficiency. 

Particular  caution  must  he  employed  in  interpreting  differences  in 
productivity  levels  for  various  installations  performing  like  functions. 

In  some  caseB,  differences  in  productivity  and  in  particular  input  require¬ 
ments  may  be  entirely  due  to  differences  in  size  of  the  ins talllt ions, 
locational  factors,  and  the  like.  In  other  cases,  the  differences  may 
be  due  to  genuine  differences  In  management  efficiency  in  the  several 
installations . 

Obviously,  the  usefulness  of  productivity  measures  will  depend 
ultimately  on  management's  desire  to  use  them.  Further,  the  more  detailed 
the  measures,  the  more  potentially  useful.  Quarterly  measures  are  probably 
more  useful  than  annual  measures.  On  the  other  hand,  monthly  measures 
vi  11  tend  to  he  influenced  by  erratic  factors  and  may  not  be  significant 
indicators  of  trends. 
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The  cliche  is  often  heard  that  efficiency  measures,  such  as  pro¬ 
ductivity  Indexes,  hy  their  very  existence  tend  to  spur  the  drive  for 
greater  management  efficiency.  This  Is  possibly  true,  but  with  the 
current  proliferation  of  various  measures,  an  additional  measure  must 
win  a  place  on  its  own  merit,  bly  guess  is  that,  as  a  summary  measure  of 
new  changes  in  productive  efficiency  and  in  unit  requirements  for  the 
several  inputs,  productivity  indexes  will  win  a  secure  place  in  the 
battery  of  management  statistical  tools.  But  it  is  as  an  aid  in  budgeting 
and  long-range  projections  that  I  believe  the  more  important  uses  of 
productivity  measures  lie. 

Budgeting  and  projections 

The  logic  behind  the  use  of  productivity  measures  for  budgeting  Is 
simple.  After  the  workloads  of  the  agency  are  projected,  projections 
of  the  total  and  partial  productivity  ratios  yield  the  input  require¬ 
ments  consistent  with  the  workload  and  productivity  projections.  The 
projected  input  requirements,  when  combined  with  input  price  projections, 
yield  the  cost  totals  that  must  be  budgeted  for.  Essentially  the  same 
technique  can  be  used  in  5-year  or  longer  projections. 

In  the  case  of  budgets,  however,  the  productivity  projection  can 
in  part  be  based  on  the  expected  effects  of  planned  technological  changes. 
This  is  particularly  feasible  when  the  unit  input  requirements  associated 
with  the  new  as  compared  with  the  older  technologies  are  known,  as  well 
as  the  planned  rate  of  investment  in  new  equipment,  as  is  the  case  in  the 
Division  of  Disbursement. 7  The  further  into  the  future  productivity 
projections  are  pushed,  the  greater  must  be  the  reliance  on  extrapolation 
of  past  trends.  For  this  reason,  the  accumulation  of  considerable 
historical  data  and  estimates  of  productivity  change  is  desirable. 

The  same  principle  holds  with  respect  to  input  prices.  Short-term 
forecasts  can  take  into  account  known  supply  and  demand  forces,  such  as 
labor  contracts.  Longer-term  projections  can  take  into  account  past 
relative  price  trends,  but  fewer  specific  market  forces  as  the  projection 
horizon  is  extended. 

The  short-term  projections  of  relative  price  movements  are  important 
in  estimating  the  least -cost  combination  of  inputs,  which  together  with 
the  projections  of  technological  possibilities,  should  affect  the  unit 
inpat  requirement  projections.  The  longer-term  trends  in  relative  input 
prices  in  conjunction  with  the  productivity  projection,  should  also 
affect  the  input  projections  in  at  least  a  general  way. 


?The  projected  productivity  change  might  also  be  announced  as  a  "goal," 
if  this  would  be  deemed  to  have  an  incentive  effect. 
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The  possibilities  in  the  use  of  projectivity  data  in  budgeting  and 
projections  have  been  recognized  by  Office  of  Budget  Review  in  the  Bureau 
of  the  Budget,  and  by  budget  officers  in  the  agencies.  Certainly, 
the  decomposition  of  dollar  data  into  price  and  quantity  elements  is  an 
important  statistical  and  analytical  step  forward. 

Directions  for  Future  Work 


It  is  to  be  hoped  that  the  Office  of  Management  and  Organization 
in  the  Budget  Bureau  will  continue  to  provide  leadership  in  the  field 
of  productivity  measurement  and  analysis.  Centralized  leadership  helps 
to  provide  standardization  of  measurement  methodology  which  conduces  to 
inter-agency  comparisons,  and  promotes  the  sharing  of  fruitful  technological 
innovations  across  agency  lines . 

Productivity  studies  should  be  encouraged  in  all  organizations  most 
of  whose  outputs  are  sufficiently  homogeneous  through  time  to  permit 
meaningful  measures.  It  is  my  impression  that  most  civilian  agencies 
would  fit  this  description,  and  some  of  the  functions  of  the  Department 
of  Defense  particularly  in  the  supply  and  maintenance  areas.  Certainly, 
the  possibilities  should  be  thoroughly  explored. 

Once  further  progress  has  been  made  in  Federal  Government  productivity 
studies,  comparisons  might  usefully  be  made  in  some  areas  with  private 
industry;  and  in  many  areas  with  counterpart  functions  in  Govemement  of 
other  countries. 

The  studies  will  be  futile,  however,  unless  they  are  used  to  promote 
technological  and  organizational  advances  in  Government,  including 
improved  budgeting  procedures. 
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CHANCE- CONSTRAINED  PROGRAMMING  AND  RELATED  APPROACHES  TO  COST  EFFECTIVENESS 


1.  Introduction: 

Ibis  paper  is  intended  to  supply  a  broad  survey  of  recant  research 
for  Its  possible  bearing  on  cost-affactivsness  measures  and  related 
aspects  of  planning  and  evaluation.  At  the  outset,  then,  we  might  well 
Identify  some  aspects  of  the  points  of  view  which  have  governed  this 
survey.  Inter  alia,  this  will  also  help  us  to  present  an  overview  of  the 
structure  and  die  course  of  the  developments  pursued  In  the  sections  that 
follow. 

First,  wa  believe  that  such  a  survey  nay  bast  be  conducted  by  according 
the  term  "cost/effectiveness"  only  generic  significance  so  that  It  than 
covers  any  system  for  measuring  benefits  and  the  resources  that  must  be 
expended  to  secure  them.  Second,  we  believe  that  any  meaningful  system  of 
measures  suet  be  related  to  an  underlying  model  and  that,  further,  it  la 
generally  advisable  to  make  these  models  explicit  whenever  the  resulting 
measures  ere  to  be  us«d  for  analysing  complex  systems.  Third,  the  models 
wa  deal  with  are  of  a  ao-callw*.  optimisation  variety  and,  in  particular,  the 
resulting  coet-effectlveness  measures  and  related  trade-off  evaluations 
depend  on  these  optimality  properties  for  their  full  slgnif icanca.  Fourth, 
the  models  end  the  related  research  we  examine  are  of  a  so-called 
constrained  optimisation  variety.  Fifth,  we  era  concerned  to  note  that  such 
constrained  optimisations  are  not  confined  either  (a)  to  those  types  of 

y 

problems  where  only  a  single  measure  of  a  "best*1  result  can  be  defined 

y  Sea,  e.g. ,  pp.  379  ff.  in  C.  J.  Hitch  and  K.  M.  McKean  [37]  for 
discussions  that  are  pertinent  to  '’efficiency"  in  a  military 
context*  CM umber*  in  square  bracket  refer  to  the  references  listed 
in  the  bibliography  at  the  end  of  tills  papas. ) 
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or  (b)  to  thosa  situation*  in  which  the  numbers  (and  related  symbols) 
must  have  all  of  the  properties  usually  accorded  to  them  in  ordinary 

y 

arithmetic.  Finally,  w*  shovld  also  note  that  the  formulation  if  such 
a  model  is  a  beginning  rather  than  the  end  of  a  process  that  extends 
from  using  the  model  as  a  mod*  of  clarifying  objectives  and  extends 
through  its  use  as  a  guide  to  data  collection  and,  ultimately, 

y 

reformulation  of  the  model  itself. 

With  these  points  in  mind  we  now  summarize  the  remaining  portions 
of  this  paper.  In  section  2  a  or 4c is  is  supplied  of  the  processes  for 
effecting  cos t-and -benefit  calculations  which  ere  standard  In  economies 
and  accountancy.  Features  of  the  underlying  models  are  identified  by 
reference  to  the  optimality  assumptions  which  often,  perhaps  implicitly, 
accompany  such  analyses.  Section  2  then  concludes  with  a  delineation  of 
extensions  that  might  well  be  effected  to  other  contexts— as  is  now 
possible — by  using  the  results  of  research  (end  accompanying  applications) 
in  linear  programming  and  its  subsequent  extensions. 

Tn  section  3  we  proceed  to  supply  a  variety  of  examples,  with  special 
reference  to  chance  constrained  progrmaming,  as  one  way  to  lend  concrete 
significance  to  some  of  our  preceding  characterisations. 

The  models  (i.e. ,  those  which  have  been  customarily  employed 
for  many  years  by  Industry  and  government)  described  in  section  2  often 
proceed  in  so-called  ceteris  paribus  fashion— on*  variable  is  aitared 
while  ell  others  ere  held  constant  and  so,  by  way  of  contrast,  an 

1/  Sae,  e.g. ,  ft.  J.  Aumann,  "Sub J active  Programming"  in  (60.1)  and  sen 
also  pp.  280-282  and  pp.  753-757  In  [12). 

2/  Xid£  (10)  and  (16). 

3/  Saa,  e.g..  Hitch  and  McKean,  loc.  cit.  [37]  p.  362. 
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■ltimti  approach  la  next  illustrated  in  taction  4  by  reference  to  a 
linear  programming  example  for  shlp-asslgnseats  to  accoupllsh  certain 
aiaaiona.  This  ship-to-nlsslon  assigns  snt  modal  la  restricted  only  to 
a  deterministic  context  ao  that  particular  attention  night  thereby  be 
directed  in  a  fairly  alalia  way  to  the  to -cal  led  duel  evaluator  a— 
which  proceed  in  nutatla  nutandia  fashion  to  examine  the  consequences 
of  altering  requirements  by  supposing  that  all  relevant  variables  are 

V 

optimally  adjusted  to  each  such  alteration. 

As  we  have  already  indicated,  the  nodal  used  in  section  4  la 
both  staple  and  deteralnistie.  It  is,  in  fact,  a  linear  programming 
nodal.  But  this  is  not  the  only  way  in  which  we  shall  treat  this  model, 
■meant  years  have  witnessed  research  that  has  been  directed  to  expending 
ordinary  llnaar  programming  so  that  constrained  optimizations  may  be 
employed  in  contexts  diere  probabilistic  considerations  must  be 
explicitly  accosmodated.  This  is  illustrated  in  the  sections  that 
follow.  For  Instance,  in  section  5  the  topic  of  "stochastic  linear 
programming1*  Is  Illustrated  by  Indicating  hew  an  entire  probability 
distribution  of  optimal  "figures  of  merit"  may  ba  derived  when  random 
elements  are  present.  But  this,  it  should  be  noted,  is  only  one  of 
the  possible  approaches  diet  have  emanated  from  the  research  diet  has 
now  been  undertaken  in  thnse  "probabilistic  programing  arses."  Note, 
for  example,  diet  stochastic  linear  programming  assumes  that  ell 

y 

constraints  are  always  satisfied.  In  son*  situations,  however,  it  may 

U  See  pp.  16  ff.  in  [12]  for  further  dlscussiom  of  such  ceteris 
paribus  and  nutatla  mutandis  adjustments. 

y  9>is  is  also  true  of  "linear  programming  under  uncertainty,"  as 

formulated  by  G.  B.  Dantslg.  See,  e.g.  ,  [29]  and  [30]* For  reports 
of  other  recent  research  on  linear  programing  under  uncertainty 
see  [22]  end  [23]  do 


be  Bteuiiry  to  cons  1  dor  the  possibility  of  constraint  violations  in 
a  way  that  •nobis*  ona  to  proscribe,  control  and  evaluate  tho  attendant 
risks  for  each  conponant  (constraint)  in  a  complex  systsai. 

This  brings  us  to  the  topic  of  "chance  constrained  programing" 
which  occupies  Sections  6  and  7.  The  inner  introduces  this  topic  in 

y 

a  very  slnple  context  and  concludes  with  suggestions  for  ways  in  which 
new  measures  may  be  derived  from  sn  already  attained  solution.  The 

y 

latter  introduces  a  variety  of  objectives  and  discusses  hew  these 
may  be  combined  with  other  considerations  to  produce  both  different 
and  similar  results. 

In  section  8  we  again  return  to  deterministic  situations  in  order 

to  obtain  entry  into  the  topic  of  multiple  objectives.  This  is  done  by 

1/ 

reference  to  the  ideas  of  "efficiency"  as  developed  by  T.  C.  Koopmana 

which  are  then  reduced  and  simplified  by  recourse  to  already  available 
4/ 

artifacts.  Finally,  in  section  9,  the  idea  of  multiple  objectives  Is 

y 

extended  and  adjusted  to  problems  stated  explicitly  in  probabilistic 
form.  The  findings  and  evaluations  that  are  stated  at  various  points 


i/  1.  e. ,  by  reference  to  the  so-called  aero  order  rules  of  chance- 
constrained  programming 

2/  With  the  statistical  characterizations  that  are  generally  required 
for  the  so-called  higher  order  rules  of  chance-constrained 
programming. 

y  Sea  [42]. 

4/  As  presented  in  Chapter  IX  of  [12]. 

y  By  reference  to  the  ideas  of  "functional  efficiency"  as 
presented  in  Chapter  IX  of  [12]. 


89 


throughout  tha  auauaerlpt  art  than  txttndad  in  • act ion  10  for 
thair  boaring  on  roaoarch  iaauaa  and  poaaibilitioa  for  practical 
lmplawantation  with  apocial  reference  to  the  toplca  cover  ad  in 
section  0. 
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2. 


One -Pimm  Iona  1  Approaches  to  Cost  and  Benefit  Measurements 
The  measoreaent  procedure*  for  effecting  choice*  In  private  eater* 
prises  might  be  idealized  along  lines  like  the  following.  First*  ell 
pertinent  attributes  are  identified  in  their  respective  dissensions. 

Second,  only  those  attributes  which  are  variable  for  the  decision 

y 

under  consideration  are  singled  out  for  explicit  attention.  A  single 
measure  of  "value"  is  then  assigned  to  each  such  variable  in  a  way  that 
makes  it  possible  to  obtain  a  unidlmerrs tonal  scale  along  which  comparisons 
can  be  effected  for  ascertaining  the  "costs"  and  "benefits"  accruing 
from  each  possible  state  that  might  be  assigned  to  the  underlying 
attributes. 

This  is  a  very  general  description  of  procedures  that  are  supposedly 
employed  for  effecting  choices  in  many  contexts.  Thus  in  the  literature 
of  economics  and  cost  (and  managerial)  accounting,  for  instance,  this 
kind  of  reduction  is  supposed  to  occur  in  preparation  for  reaching  a 

y 

best  decision.  In  the  cost  accounting  literature,  in  any  event,  the 
relevant  scale  is  a  monetary  one.  Along  the  indicated  scale  a  best 
decision  will  then  be  one  in  which  produces  results  like  the  following: 

1/  l.e. ,  thoee  attributes  which  can  be  made  to  vary  in  some  way— 
perhaps  dlscontinuously— and  thereby  also  produce  e  variation 
along  the  indicated  scale. 

2/  See,  e.g. *  Chapter  4,  "A  Comprehensive  Restatement  of  the  Theory 
of  Cost  sad  Production"  in  P.  A.  Sarmtelson*  [56]  as  well  as 
pp.  47-  SO  ff .  in  R.  Beyer  [7]. 


91 


(•)  nat  benefits  ara  adequate  to  cover  all  of  the  lad  1  cat  ad  varlaUa 

eoata  and  (b)  no  othar  choica  will  produca  a  (rtatcr  posltlva  air— 

In  tha  diffaranca  batwaan  benefits  and  eoata.  In  particular,  than*  a 

boat  choica  will  be  one  which  cannot  be  battered  by  increasing  or 

dacraaaing  tha  value  of  any  variable.  That  1%  no  variable,  in  ita 

own  dimen  a  ion ,  can  be  altered  to  produca  a  batter  rmsult  as  maaauni 

on  tha  indicated  one -dimensional  scale. 

Various  further  rafineaanta  would  be  needed  to  coaq>late  this 

description.  Relevant  extensions  would  include  considerations  of 

stability,  variations  over  differing  intervals  of  time,  related  iaenaa 

of  risk  or  uncertainty  and  possibly  other  desiderata  as  well.  These 

issues  have  already  been  well  attended  to  by  others,  however,  and  since 

the  results  of  this  prior  resaarch  ara  now  readily  available  we  neat 

1/ 

not  dwell  upon  then  here.  Our  objective  is  rather  to  exanine  aoea 
further  extensions  from  acre  racent  research  and  so*  for  background 
only,  ws  now  summarise  so—  of  the  salient  features  end  assuaptioes  ef 
these  prior  approaches: 

A.  Assumptions  of  Optimum  Choice  and  Technology;  It  ia  usually 
assumed  that  all  adjust— nts  are  optima liy  effected.  By  tills 
ws  mean  that  (a)  all  coats  ere  held  to  a  minion  at  each  poesMs 
value  of  the  related  variables  and  (b)  all  benefits  are  similarly 
pushed  to  their  corresponding  maximum  values.  In  other  words* 
relative  to  the  lndiceted  one-dimensional  scale,  the  cost  sad 
revenue  (benefit)  functions  are  each  supposedly  et  the  minis— 
end  maximum  values  admitted  for  each  of  the  variations  being 
considered.  Given  this  assumption  of  e  "best**  set  of  functions, 
the  decision  problem  then  reduces  to  choosing  values  for  the 
relev  mat  variable  In  order  to  maximise  the  difference  in  the 
values  that  will  be  secured,  as  scored  from  these  already  erected 


y  Sea  tha  references  already  cltad  as  wall  as  F.  and  V.  Luts ,  £4Sj 
and  S.  Alexander,  et.  el*,  as  cited  on  p.  147  sf  [2]. 
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benefit  and  penalty  function*.  Thus ,  for  terminological 
convenience  we  nay  divide  this  into  a  two-stage  process: 

At  stage  one,  a  beat  set  of  functions  is  determined.  At 
"stage-two"  the  relevant  variables  are  then  assigned  preferred 
values  by  reference  to  their  cost  and  benefit  coesaquencaa. 

We  should  note  that  the  stage  one  and  stage  two  choices  are 
generally  effected  by  reference  to  the  same  one -dimensional 
scale  so  that,  in  particular,  the  choice  of  such  a  scale 
aust  presumably  be  made  prior  to  the  stage-one  choices. 

We  should  also  note  that  the  stage  two  variables  which  are 
relevant,  as  well  as  their  range  of  possible  variations, 
etc. ,  is  decided  (at  least  in  part)  at  stage  one. 

A.l  Discussion  and  Illustretlon:  In  cownrclal  and 
governmental  practice,  such  stage-one  decisions 
may  be  viewed  as  revolving  around  choices  of 
equipment,  plant  layout  and  design,  and  even 
a  "beat"  organisation  arrangement.  1/  Given  such 
stage-one  determinations,  the  stage-two  decisions 
may  then  be  collectively  interpreted  as  being 
confined  to  choices  of  Input-output  combinations 
which  best  meet  an  organisation's  requirements  and 
opportunities.  Both  seta  of  decisions  are  effected, 
in  any  event,  by  reference  to  their  consequences 
as  these  night  be  judged  and  evaluated  along  some 
pertinent  one-dimensional  scale  of  values. 

A. 2  Remark:  To  some  extent  this  stage-one  and  stage- 
two  division  is  arbitrary.  For  Instance  an 
intenaedlate  category  may  also  be  introduced,  when 
necessary,  to  allow  for  the  development  of  oper sting 
guides— e. g. ,  standard  costs  and  budgetary  relations, 
as  well  as  bills  of  materials,  manning  tables  and 
planning  factors.  Tima -and -motion  and  methods 
studies— and  related  aunagerial  activities— may  be 
regarded  as  members  of  this  intermediate  class. 

We  should  than  note  that  such  studies  often  include 
allowances  for  training  workers  and  effecting 
equlpaMnt  changes.  Thus,  as  these  examples 
illustrate,  this  Intermediate  category  may  altar 
the  previous  stage-one  decisions  and  enter  into 
the  subsequent  stage-two  decisions  as  well.  la 
any  case,  resource  expenditures  aust  than  also 
be  considered  relative  to  such  intermediate 
activities  and  these,  too,  aust  be  calibrated  aad 
evaluated  along  the  or  j -dimensional  scales  which 


1/  A  more  precise  characterisation  would  distinguish  elements  within 
each  of  these  categories  that  continue  to  be  variable  at  stage 
two.  See,  e.g. ,  Suae  Carlson  (8]  pp.  IS  ff.qnd.  V*  levy  (43) 
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vc  arc  presently  considering.  By  means  of 
suitable  mathematical  expressions,  we  shall 
later  try  to  make  these  stat«»ents  more 
precise.  For  the  isomen t ,  however,  we  may  note 
that  the  need  for  distinguishing  such  categories 
is  dependent,  in  part,  on  the  available 
technologies  from  which  choices  oust  be  made. 

It  is  also  dependent  on  tike  managerial  tools 
and  hence  on  the  results  that  research  can 
make  available  for  effecting  simultaneous 
stage-one  and  stage-two— as  well  as  intermediate- 
stage— choices  in  realistic  contexts. 

Pate  Requirements  and  Availability;  Assumptions  of  data 
availability  and  use  are  also  moot.  Such  assumptions  evidently 
apply  when  a  choice  of  scales  is  being  considered.  They  also 
cover  the  initial  task  of  identifying  and  classifying  the 
relevant  variables  as  well  as  the  further  tasks  of  determining 
the  relations  that  govern  the  behavior  of  these  variables 
insofar  as  these  bear  on  the  values  that  will  subsequently 
emerge  on  any  value  scale  that  will  subsequently  be  employed. 

These  remarks  are  Intended  to  be  sufficiently  general  so  that 
they  will  cover  managerial  decisions  in  either  probabilistic 
or  deterministic  contexts.  2/ 

B.  1  Deterministic  Analysis  and  Decisions:  It  is  usually 
assumed  that  all  pertinent  data  are  available  as 
needad  at  relatively  triviel  expenditures  of  cost  and 
effort.  This  assumption,  however,  needs  to  be 
interpreted  rather  carefully.  Thus,  for  instance, 
as  we  have  already  emphasized ,  costs  (and  benefits) 
which  ere  fixed  may  be  ignored.  Furthermore,  when  a 
marginal 1st  or  Incremental  approach  is  being  used  one 
may  suppose  that  only  a  knowledge  of  the  increments 
to  cost  and  benefits  will  provide  ell  of  the  requisite 
information.  Indeed,  it  can  be  shown — in  a  very  general 
class  of  cases— that  even  the  increments  to  cost  need 
not  be  available  provided  that  other,  perhaps  more 
readily  obtainable,  "surrogate"  data  are  at  hand.  3/ 

B.  2  Probabilistic  Analysis  and  Decisions;  Questions  of 
date  availability  ere  also  pertinent  here,  of  course. 

See,  e.g. ,  (17]  for  e  detailed  development  of  models  and  related 
modes  of  analysis  and  computation. 

In  some  cases  the  letter  mf.ght  be  further  subdivided  into  situations 
of  "risk"  (probabilities  ere  known)  end  of  "uncertainty1* 
(probabilities  are  not  known). 

See  the  discussions  end  further  references  supplied  in  Chapter  XI 
of  [12]. 


and  unless  so -called  "certainty  equivalent"  \f 
or  "deterministic  equivalent"  2/  reductions 
can  be  affected  one  may  suppose  that  the  data 
requirements  will  generally  be  more  onerous  than 
In  deterministic  cases.  For  instance,  the  solution 
of  a  probabilistic  problem  may  make  It  necessary  to 
determine  parameter  values  or  even  entire  probability 
distributions.  This  may  be  a  difficult  job.  3/ 

It  may  even  be  impossible  without  recourse  to  research 
that  will  extend  the  boundaries  of  existing 
statistical  theory,  perhaps,  or  at  least  Increase 
the  efficiency  of  some  of  its  procedures  for 
estimation  and  computation.  Even  this  may  not 
be  wholly  adequate,  however,  since  still  deeper 
Issues  may  arise  concerning  the  choice  of  a 
"rational"  objective  which,  in  turn,  can  also 
raise  many  questions  concerning  the  choice  of 
suitable  scales  for  measuring  and  evaluating  the 
consequences  of  possible  choices  for  decision. 

B.3  Remark:  He  shall  return  to  this  latter  topic  in 
subsequent  portions  of  this  paper.  Here  we  should 
note  that  one  course  of  argument  runs  to  a 
development  of  "utility  functions”  in  order  to 
produce  yet  another  one-d  lawns ional  scale  which 
will,  supposedly,  resolve  the  choice-of-objectives 
problem  noted  under  B.  2.  There  may  be  practical 
difficulties  In  the  way  of  such  an  approach,  however, 
and  these  nay  be  compounded --even  as  a  matter  of 
principle — when  more  than  one  decision  maker  is 


1/  See,  e.g. ,  Chapter  6  in  [38]. 


2/  This  terminology  la  borrowed  from  the  literature  of  "chance- 
constrained  programing. "--See,  e.g.,  [11]. 


2/  Some  relief  may  be  secured  if  one  is  willing  to  proceed  via  a 

judgmental  (or  subjective)  assignment  of  the  relevant  probabilities 
See,  e.g. ,  H.  Half  fa  and  R.  Schlsifer  [54]  or,  at  a  more  elementary 
level,  see  R.  Schlsifer  [58]. 
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lnvolvsd.  2/  Furtharmora ,  out  say  obtarva  due 
thna  it  no  a  priori  raaioo  to  auppoaa  that  tbs 
resulting  “utility  acala"  auat  necessarily  ba  ons- 
dimensional.  That  is.  ona  nay  also  entertain  Ch« 
possibility  that  ths  resulting  utilities  ara  multi¬ 
dimensional  In  a  saasa  that  doas  not  admit  of 
diract  comparisons  and  immediate  substitutions 
batwaan  dlffarant  good-aad-penaltles  eoabiBations.  2/ 
Finally,  it  is  not  elaar  that  ona  can  always  safaly 
assume  tha  usual  consistency  axloaas  and  tharaby 
circumvent  tha  naad  for  formulating  utility  functions 
thansslvas  on  a  probabilistic  basis. 

With  tha  pracadlng  discussion  as  background,  wa  way  now  tun  to 
tha  min  suggestions  of  tha  pros ant  papar.  First,  wa  shall  suggest  that 
reduction  to  a  single  scale— hereafter  called  a  "scalar-objective" 
approach— way  not  ba  adequate  for  nsny  governmental  and  military 
purposes.  Second,  wa  shall  suggest  diet  it  is  desirable— or  avan 
necessary— to  consider  nodals,  and  related  methods  of  analysis  and 
computation,  which  effect,  say,  many  of  tha  stage-one  and  stage-two 
choices  simultaneously,  even  under  probabilistic  conditions.  Third, 
we  shall  also  suggest  that  optimisation  considerations  should  continue 
to  apply  as  pertinent  features  for  judging  any  such  modal  and  its  related 
modes  of  computation  and  analysis. 

For  an  Immediate  illustration  wa  may  consider  the  acquisition  of 
a  new  weapon  system.  It  seams  safe  to  say  that  ona  or  son  stages  of 


1/  See.  e.g. ,  L  Arrow,  [3]  for  a  discussion  of  same  ef  these  basic 
(in  principle)  difficulties.  Sea,  also,  however,  S.  Alexander  [1] 
for  a  suggested  way  of  dealing  with  soma  of  thasa  difficult las. 


%)  Vida,  a.g. ,  Chapters  XII  and  XXII  by  M.  Bane nsr  and  X.  M. 
respectively,  in  R.  M.  Thrall,  C.  E.  Coombs  and  t.  1»  Davis, 

Saa  also  John  Chipman,  [28]  as  wall  as, tha  mors  racant  survsy ,  from 
a  behavior  is  tiewndeorgani,  rational  standpoint  in  Shqptar  1  of 
M.  V.  Shslly ,  II,  and  O.  L.  Bryan,  [60]. 
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the  decisions  Must  Involve  probabilistic  considerations.  Simultaneity 
is  also  likely  to  be  a  feature  that  should  be  considered  Insofar  as, 
say,  costs  and  benefits  are  likely  to  be  related  not  only  to  systsa  and 
component  designs  but  also  to  the  quantity  as  well  as  the  quality  of  the 
weapons  end  related  support  itaas  that  night  ba  ordered.  Finally,  las ues 
of  optimality  are  also  likely  to  be  present.  This  is  true  even  If 
multi -dimensional  objectives — and  related  scalings— are  being 
employed  since  without  such  optimality  properties  the  resulting  evaluations 
and  substitutions  nay  be  erroneously  nade  without  reference  to  their 
"best"  consequences  on  all  parts  of  a  proposed  weapons -systam  complex. 

We  can  perhaps  make  this  last  point  somewhat  note  concrete  by 
considering  how  the  decisions  for  such  s  canplax  might  ba  affected  via 
suitably  arranged  simulations  of  a  machine  or  hand  variety.  Presumably 
such  simulations  would  make  it  possible  to  examine  many  possible 
arrangements  of  the  component  elements  in  order  to  assess^-or  evaluate— 
their  consequences  for  system  designs.  But  even  this  might  not  be 
wholly  adequate  unless  related  ideas  of  optimisation  are  also 
employed.  This  need  not  exclude  the  possibility  of  continuing  simulations, 
however,  since  such  optimisations  may  also  be  used  as  guidaa  or  a a 

V 

controls.  Tha  point  is,  of  coursa,  that  such  gu  id  as  or  controls  msqr  be 
needed  to  reduce  the  likelihood  of  overlooking  potentially  valuable 
opportunities  in  any  of  the  pertinent  dimensions.  Thasa  comments  acquire 

See  in  Chapter  S  of  [10]  for  discussion  of  die  use  of  each 
”  simultetlon  controls  in  an  axampls  that  involves  *  multi* 

dimensional  objective  (vis. the  design  of  e  network  of  city 
streets.) 
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even  greater  force  at  atagaa  whan  design  changes  are  to  be  affected 
and  whan  risks  of  failure  as  wall  as  levels  of  performance  must  be 
considered  in  «  many -dimensional  evaluation  context. 

Ha  shall  shortly  provide  other  examples  and  illustrations. 

Commencing  with  ona-dlmanaional  scalar  objectives  wa  shall  than  want 
to  continue  in  order,  finally,  to  examine  research  possibilities  and 
potential  applications  for  models  that  are:  (1)  multi-dimensional  in 
their  measures  sof  effectiveness,  essentiality,  etc.;  (2)  adaptable 
to  probabilistic  contexts;  and  (3)  have  explicitly  stated  optimising 
objectives  either  in  their  own  right  or  because  they  are  wanted  a a 
guides  or  controls  for  the  simultetione  that  are  to  be  conducted. 

3.  Some  Examples  of  Chance-Constrained  Programing  with  One-Dimensional 
Objectives: 

Chance  constrained  programing  extends  the  ideas  of  ordinary  linear 

prograssaing  to  comprehend  decision  making  in  situations  where  probabilistic 

else ants  must  ba  explicitly  considered  as  integral  parts  of  the  model. 

Examples  which  may  be  suggestive  of  chance  constrained  programing  and 

1/ 

related  approaches  end  possibilities  are  as  follows: 

1.  FEU  -  Critical  Path  Analyses  in  which  ell  or  soam 
of  the  times  for  the  links  associated  with  a  project 
graph  ere  known  to  vary  statistically.  This  approach 


1/  E.g. ,  stochastic  programing  and  linear  programming  under 
uncertainty.  Vide,  e.g.,  [29]  end  [69]. 
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than  lands  to  • 

variety  of  new  possibilities  such  as  (1)  explicitly 
determining  a  statistical  distribution  for  the  overall 
project  completion  tines  or  (2)  ensuring  that  the 
project --or  subportions  thereof --are  completed  within 
specified  Claws  et  prescribed  levels  of  probability.  1/ 

2.  Choosing  a  course  of  studies  and  related  ftfiD  activities 
preparatory  to  introducing  a  new  product.  Here,  too,  a 
network  or  graph  approach  is  utilised  although  these  ere 
inherently  more  complex  than  those  utilized  in  the  PERT 
or  Critical  Path  Variety.  If  For  one  thing,  the  network 
is  not  restricted  to  the  simple  dimension  of  "time" 
only.  Different  possibilities  for  awrketlng  studies  are 
considered  along  with  their  costs  and  related  statistical 
qualities.  Further  supplementary  conditions  are  also 
simultaneously  considered  along  with  the  network  (or  graph) 
possibilities.  These  include  the  limits  of  allowable  funds 
budgeted  for  the  studies.  They  also  include  risk  allowances 
stated,  for  instance,  in  terms  of  "payback  periods" 
(formulated  as  chance  constraints).  3/  Finally,  the 
objective  is  also  more  complicated  than  the  ones 
encountered  in,  say,  PEKT-type  networks  since  (a) 
time  alone  4/  is  not  a  decisive  consideration  and  (b) 
various  priorities  or  "preemption"  posslbllltlea  5/ 
must  be  allowed  for. 


1/  See,  e.g. ,  [24].  See  also  [32],  [40]  and  [49]. 


2/  See  [19]  and  [20]. 


3/  Note  that  this  use  of  payback  as  a  risk  constraint  accords  it 
the  status  of  a  "screeaitg  mechanism"  and  thus  this  treatment 
differs  from  the  usual  ones  (described  in  the  finance -and 
accounting  literature)  wherein  payback  is  generally  accorded  the 
status  of  an  "objective".  (He  shall  make  this  terminology  somewhat 
more  precise  in  the  inaediately  following  sections. ) 

4/  E.g.,  time  as  interpreted  via  "payback  period"  constructs 

5/  in  the  sense  of  a  system  of  a  "preemptive  priorities"  of  the  kind 
used  in  the  literature,  say,  of  queuing  theory.  See,  e.e. , 
pp.  237  ff.  in  T.  L.  Saaty  [55]. 


3.  Scheduling  production,  transportation  and  inventory  to 

meet  dew  and  a  that  can  only  be  anticipated  probabilistically— 
end  to  do  so  In  a  way  that  minimizes  the  expected  sue  of 
production,  shipment  and  Inventory  carrying  for  a  sequence 
of  time  periods. 

Here  a  utilisation  of  chance  constrained  prograanlng  makaa 
it  possible  to  prescribe  levels  of  quality  and  reliability 
of  service  and  then  to  evaluate  the  eonsequeacea  of 
altering  any  or  all  of  these  levels,  y 

4.  Chance-constrained  programming  also  offers  an 
approach  to  queueing  pr  obi  sms 

in  which  the  queues  nay  be  partially  controlled  or 
Influenced  by  managerial  decisions,  in  this  approach— 
ustllke  more  usual  queueing  models— the  decision  rules 
and  related  optimizations  are  explicitly  stated  as  an 
Integral  part  of  the  nodal.  A  case  in  point  Involves 
scheduling  tankers  to  a  refinery  in  which  Inventory 
awaiting  withdrawal  must  'be  simultaneously  scheduled  in 
the  li^it  of  tanker  availability  and  route  reassignment 
possibilities.  2/  The  explicit  incorporation  of  an 
optimising  objective  then  makes  it  possible  to  provide 
evaluations  that  extend  to  altering  docking  aid  storage 
facilities  as  well  as  refinery  end  tanker  capacities. 

All  of  the  above  examples  proceed  by  reference  to  s  scaler 
objective.  The  Issue  of  which  objective  should  be  elected  thus  becomes 
moot.  Us  shall  subsequently  returrx  to  this  topic  in  order  to  Indicate 
some  of  the  elections  that  are  now  aval  labia  and  then,  by  reference  to  am 
hypothetical  military  application,  show  some  of  the  further  multi-dimensional 
posslbilitiaa  that  night  alao  be  azwined. 


\f  See  [13]  and  [21],  See  also  [51]. 

If  Cf.  t$3* 
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4.  g«a  Terminological  Definitions  and  Concept* t 


In  this  section  our  lmnsiUeta  purpose  is  to  de£iue  snd  clsrlfy 
sobs  key  terms  end  concepts  and*  to  this  end,  we  utilise  e  somewhat 
artificial  and  hl^ily  simplified  example. 

He  may  develop  the  idea  of  a  “scalar  objective"  .long  lines 
Ilka  the  following,  let  be  the  number  of  ships  ~f  class  1  that 
might  be  assigned  to  a  particular  "fleet"  or  "task"  force.  Let  c, , 

y  1 

a  known  constant,  be  the  cost  par  year  of  swintaining  a  ship  of 
class  i.  these  numbers  will  hereafter  be  called  criterion 
alaaMtnts.  He  suqr  also  define  a  number  g,  a  scalar,  by  the  relation 


<l>  *  "  t-1  °l  *l  *Cl*I+  *2  *2  +  **’  +  C»  * 


and  than  refer  to  this  g  as  e  "figure  of  Mrlt"— i.e. ,  a  "numerical 
score"  which  results  from  any  assignment  of  values  with  the 
indicated  we  lutings. 

Mext  we  introduce  the  idea  of  a  "constraint"  as  follows.  Suppose 
we  have  e  set  of  known  constants  a^  and  suppose  we  let  each  such 
constant  represent  the  effectiveness  of  a  chip  in  dess  i  whan  it  is 
assigned  to  mission  j.  these  a^  values  night  be  reted  reletlve  to 


\J  this  example  is  only  illuetretlve,  of  course,  and  the  criterion 
elmeente  ere  here  accorded  the  interpretation  of  "coats"  only  for 
concreteness.  More  complex  weightings  may  be  utilised  and,  if 
desired,  the  above  concept  of  %  "figure  of  merit"  may  be  utilised 
even  when,  say,  preemptive  priorities  and  other  such  criterion 
elsments  ere  vented  even  though  the  letter  ere  not  considered  to 
be  "mensurable"  in  common  numerical  usagae.  See,  e*g. ,  [123  and  [ll]. 
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som  seals  such  as,  say,  a  purs  nusbsr  seals  ranting  from  ^1,000. 

On  this  sous  seals  vs  sight  thsn  rats  each  of  J-l . .  si  as  Ions  by 

scans  of  nusbars  that  represent  tha  ralstivs  difficulty  of  sadk 

such  Mission."  By  reference  to  these  a^  values,  as  given,  we  sight 
thsn  seek  to  effect  ship  assignments  that  will  accomplish  all 

missions  at  the  indicated  difficulty  levels  tj.  By  assusing  that  all 
constraints  are  given  as  linear  inequalities  we  could  then  translate 
this  into  mathematical  terns  as  follows:  "Choose  values  w^  which 
satisfy  "constraints"  of  the  form 


<2> 


2  *i  *ij  *  6 


i-1 


J’ 


£  0, 


therm  being  n  such  constraints,  in  ail,  that  must  be  simultaneously 

y 

satisfied. 

A  formulation  such  as 


Plus,  of  course,  the  n  "non -negativity  constraints,"  v_,  £  0, 

i— 1 ,  2 . m.  We  should  also  note  that  this  may  have  . 

to  be  accorded  an  integer  progr seming- -or  mixed  Integer  programming 
characterization  when  some  of  the  w,  must  refer  to  “whole  ships. " 
Ve  do  not  discuss  this  topic  hsrs  but  refer  rather  to  sosm  of  the 
surveys  that  arc  already  available.  See,  e.g.  ,  A.  Ben  Israel  and 
A.  Chames  [6]  as  wall  as  R.  M.  Young  [74].  Sea  also  R.  Gomory 
sad  W.  J.  Baumol  [35]  as  well  as  H.  M.  Weingartner  [73]  for 
sxenlnatlons  of  svsluational  possibilities.  For  some  recant 
research  on  algorithms  see,  G.  L.  Thoepson  [66]  and  F.  Glover  [34]. 


102 


minimize  g  ■ 

sub j set  Co 


(3) 


L  w  e 
iml  1  1 


A *  ej 


with  1-1,  ...»  m,  j  -1,  ... ,  a;  would  chon  produce  o  "linear  programming 

V 

modal"  with  the  objective  "minimize  g."  This ,  then,  comprehends  what 
we  a«an  by  a  scalar  objective— viz. ,  "optimize  a  specified  (scaler) 
figure  of  merit."  The  term  "optimise"  is  meant  to  include  tame 
such  as  "maximize"  and  "minimize"  and  the  related  model  is  Chen  referred 
to  as  ?.T.  "optimizing  modal." 

For  further  clarification  we  should  note  that  none  of  this  gainsays 
a  use  of  other  objectives  such  as,  say,  "secure  a  satisfactory  figure 
of  merit"  and  so  on.  Moreover,  in  our  usage  the  term  "objective"  is 
not  Co  be  construed  as  being  confined  to  linear  programming  models. 

It  is  meant  to  apply,  rather,  in  any  case  where  a  figure  of  merit 


1/  We  omit  the  further  constrelnte  which  would  probebly  be  needed 
in  e  more  realistic  modal.  Specimen, constraints  which  spring 

readily  to  mind  are:  (1)  Z  w  £  Wg  where  W  la  a  maximally 

•IS  1 

available  number  of  ships  of  a  specified  eleas  and  (2) 

V  >  Z  v.  >  W,  where  W„  and  W  are,  respectively, 
u  “  keg  *  1  u  L 

upper  and  lower  limits  within  which  indices  a^  and  t^  ere 

valid  approximations.  Cf. ,  e. g. ,  Chs.  X,  XVI  and  XV III  In  (123* 

8 as  also  Chapters  1  and  II  In  Xjlrl  [39], 
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la  to  ba  used  la  association  with  an  exploit  or  implicit  s tat— sat 

y 

of  bow  any  result  is  to  ba  judged. 

Ws  now  note  that  the  choice  of  a  scalar  objactivs  lap lias  the  choice 
of  a  related  figure  of  merit*  It  also  carries  certain  further 
consequences  as  when,  for  Instance,  changes  in  a  model  and  its  related 
constraints  are  being  considered.  This  leads  up  to a  process  which  we 
shell  refer  to  as  "evaluation." 

One  way  to  perform  "evaluations"  is  to  offset  trial  and  error 
substitutions  of  values  and  observe  the  resulting  figures  of 
merit  whenever  some  of  the  constraints  ere  not  fulfilled.  This  may 
also  be  extended  to  explorations  of  the  g  value  consequences  that 
night  attend  alterations  in  one  or  more  constraints.  Such  a  study 
might  focus  on  variations  of  the  initially  specified  a^  in  ordor 
to  asaass  the  desirability  of  changing  the  effectiveness  ratings  of 
one  or  more  ships  relative  to  the  indicated  tasks.  Alternatively, 
variations  in  the  tj  levels  might  also  be  assessed  in  e  similar 
manner  by  reference  to  their  potential  affects  on  the  figure -of -mar it 
values,  g. 

For  terminological  convenience  wa  may  refer  to  the  a^  as 
"structural  constants"  and  the  tj  as  "stipulations."  Studies 
directed  to  exploring  the  consequences  of  altsring  stipulation  values 
ere  sometimes  referred  to  as  "sensitivity  analyses."  Ha  shall  also 

XI  He  again  emphasize  that  these  g  values  need  not  ba  a* signed 

ordinary  numerical  interpretations.  This  is  true  even  for 
linear  programing  or  other  optimisations  that  are  not  c on f load 
to  so-called  Archimedean  fields.  See,  a. g. ,  pp.  280-282  and 
pp.  759-756  in  [12].  Sea  also  [60.1]. 


employ  this  tern  in  th*  Indicated  Banner  end  than  distinguish  it 
froa  a  "general  sensitivity  analysis"  In  which  both  structure  and 
stipulations  are  slanltaneotisly  varied  in  order  to  evaluate  the 
changes  in  g  values  sad  related  decision  consequences* 

When  an  optimization  model  of  fore  (3)  is  available  then  the 
theory  of  linear  programing  permits  another,  more  convenient,  route 
for  effecting  a  sensitivity  analysis  and  related  evaluations,  fble 
may  be  done  by  erecting  a  dual  problea  which  recasts  the  data  and 
by  mums  of  new  variables  and  objectives  proceeds  directly  to  scam 
of  the  wanted  evaluations. 

To  make  the  sense  of  ell  this  more  concrete  we  now  write  such  e 
duel  to  (3)  es 

n 

maximize  s  e  Z  t  * 

J-l  J  3 


<*> 


subject  to 


n 

Z  e 


u  xj  *  *1 

‘i*0 


Here  we  may  observe  ell  of  the  previously  noted  features— via. ,  the 
ssm  data  ere  utilised  in  easocietion  with  s  new  set  of  variables. 

Use  objective  Is  altered  along  with  the  sense  of  the  inequalities ,  and, 
finally,  the  criterion  end  stipulation  elements  ere  interchange 
Gf.  (3)  and  (4). 

Ve  now  suppose  that  both  (3)  and  (4)  have  optimal  solutions  dkieh 
mm  nay  designate  as  v*  ad  **,  respectively*  The  associated  figures  of 
■writ  nay  also  be  designated  es  g*  and  s*  Which,  by  virtue  of  the  duality 
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V 

theority  of  Ilnur  programming  producat  g*  *  i*.  Mow  tuppota  t one 

tubtat  of  stipulations  tj  ara  altarad  to  naw  values  tj  and  than 

observe  that  none  of  thasa  constants  appear  in  any  of  tha  constraints  (4). 

Thus,  by  reference  only  to  tha  relevant  criterion  elements  we  can  than 

obtain  a  new  optiaal  figure  of  merit  which  we  designate  as  i.  But 

again  tha  theory  of  linear  programing  tells  us  that  this  will 

correspond  to  a  new  value  g  which  is  optimal  for  (3).  The  latter 

figure  is  based  on  the  alterations  from  tj  to  in  the  relevant 

constraint.  Also  g  •  *  tells  us  that  g  is  optiaal.  Hence,  g 

presupposes  that,  mu tails  mutandis .  the  preceding  x*  values  are  all  adjusted 
A 

to  new  values  x  which  are  optiaal  for  the  thus  altarad  constraints 
in  (3). 

Va  nay  now  bring  this  discussion  to  its  sain  point  by  observing 
that  it  is  not  necessary  to  determine  these  x  values.  Indeed  the 
main  point  to  observe  is  that  one  nay  proceed  to  explore  the  f igurs-of- 
aerlt  consequences  for  (3)  by  varying  only  the  t,  in  (4)  in  the 

n  5 

indicated  manner.  In  each  such  variation  a  mutatia  mutandis  adjustment 
to  a  new  optimum  in  (3)  la  thereby  characterised.  Hence  a  decision  relative 
to  tj  alterations  may  be  reached  on  these  presuppositions  and  the 
resulting  trade-offs  thereby  evaluated  in  e  readily  ascertained 
and  convenient  manner. 

y  Gf.  Chapters  VI  end  VXXX  in  [12]. 

2/  3m  [12]  for  discussions  of  how  this  may  be  done  idille  allowing 
for  alterations  in  the  x  values  that  ere  optiaal  for  (4). 
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Of  court*,  v*  have  not  yat  amid  anything  about  how  evaluations 
of  tli*  a  true  turn  1  nl— ita  wight  alto  b*  ncco—odntad  under  auch  aw  approach. 
For  thla  wa  now  rafar  to  a  own  of  tha  raaulta  of  relatively  racant 
raaaarch  bacauaa  It  way  alao  halp  to  clarify  aowa  of  tha  remarks  wa 
aatarad  under  1.2  in  taction  2  above. 

Thu*  suppose  that  a^  and  values  are  given  aa  in 

(2)  above.  Than  to  admit  tha  possibility  of  changes  in  that* 
structural  and  stipulation  eltwaots  wa  now  write 

(5)  ^  Utj  +  T^)  ^ 

aa  new  constraints  to  be  considered  In  place  of  the  ones  entered  In 
(2).  Hare  tha  represent  potential  increment*  to  tha  initial 
ehlp-readlneea  (on  mission  j)  values  and  the  represent  potential 

decrement#  to  the  task  difficulties.  Thus,  in  particular,  if  wa 
assign  "costs"  to  these  and  changes  tha  problem  becomes 

one  not  only  of  affecting  ship  assign— wits  vi  but  also  of  affecting, 
simultaneously,  tha  indicated  alterations  in  a^  and  t^  values  in 
such  e  way  as  to  mast  a  minimum  cost  objective. 

We  do  not  enter  into  further  detail  with  respect  to  tha  constraints 
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(S)  except  to  note  thet  they  ere  nonllneer.  Furthermore ,  die  costa 

of  effecting  end  change*  ere  eleo  likely  to  be  nonllneer. 

Xavertheless ,  by  virtue  of  reletively  recent  research,  it  is  now 

known  bow  to  develop  e  corresponding  1  inner  progressing  nod  el  diet 

will  solve  e  problem  with  eonstrsints  like  (5)  in  e  way  thet  neets 

1/ 

the  objective  of  this  supposedly  non  1  inner  problan.  of  course,  these 
stetanents  ere  subject  to  quelif lcetion.  We  do  not  need  to  enter 
into  tills  topic  here  except  to  note  thet  enough  hes  been  eccoapllshed 
to  suggest  thet  further  reseerch  ney  neke  it  possible  to  ellmlnete 
neny  of  the  stege-one  and  stage -two  distinctions  that  we  previously 


5.  A  Stochastic  Proer— line  Approach: 

The  above  models  were  all  deterministic  end  proceeded  to 
optimizations  that  were  accorded  only  a  scalar  objective  and  evaluation 
possibilities.  Any  such  system  characterisation  would  evidently  be 
of  limited  value  in  ametlng  requirements  of  the  kind  that  are  included 
in  the  following  definition: 

"System  Effectiveness  is  the  probability  that  the 
system  can  successfully  swet  an  operational  demand 
within  a  given  time  when  operated  under  specified 
conditions."  2/ 

This  kind  of  requirssMnt  may,  however,  also  be  interpreted  in 
terms  of  the  constraint  •objective  and  evaluation  possibilities  that  we 


1/  Be*  [17]  for  detailed  discussion  and  explicitly  stated 

qualifications  that  bear  on  the  model  equivalences  implied 
by  the  above  remarks. 

2/  Source:  p.  42  r  MVHBF8  Report  14(1,  "Concepts  Associated  with 
System  Effectiveness"  (Washington,  S.  C. :  Bureau  of  Waval  Weapons, 
June,  1963). 
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htvt  already  examined.  Thus,  refer  to  (2)  and  suppose  that  tha 
constants  are  now  random  variables.  For  •  implicitly ,  suppose,  in 
particular,  that  tha  tj  ratings  are  known  to  be  determined  by 
some  statistical  distribution* 

V 

Recant  research  in  "stochastic  programing"  suggests  an 
approach  that  might  be  synthesised  along  tha  following  lines. 

Choose  a  suitable  Monte  Carlo  routine,  say,  to  generate  t.  values 

i  y 

in  accordance  with  the  indicated  statistical  distributions.  After 
each  such  set  of  values  is  genereted  apply  known  linear  programing 
methods  to  effect  w^  assignments  that  will  optimally  satisfy  all 
constraints. 

If  g*  designates  the  resulting  optimum  figure  of  merit  than 
we  can  continue  with  such  Monte  Carlo  runs  until  a  probability 
distribution  is  secured  that  looks  like  the  solid  line  represented 
by  P^  in  the  figure  below.  From  such  a  chart  ve  can  then,  of 
course,  determine  the  probability  of  securing  an  optimal  figure  of 
merit  of  value  g  ,  say,  or  below. 


\J  This  term  is  due  to  6.  Tintner.  See,  e.g. ,  [68]  and  [69]  and  [70]. 

2/  Algorithms  for  certain  classes  of  such  models  may  now  be  developed 
from  the  analytical  character  1  set  ions  given  its  [26]. 
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With  respect  Co  th«  scalar  objective,  g*,  one  now  has  an  entire 
probability  distribution  for  judging  the  results,  this,  as  already 
indicated,  provides  a  characterisation  in  which  one  nay  estimate  the 
probabilities  of  attaining  different  figura-of-nerit  levels,  although, 
of  course,  to  iom  extant  it  leaves  aside  Issues  like  the  following: 

(1)  what  is  a  "best”  objective  and  (2)  given  such  an  objective  bow 
should  the  assignments  be  aids  when  the  tj  values  rasa  in  known 

only  as  random  variables. 

The  research  of  Xlntner  and  his  associates  has  recently  bean 

y 

directed  to  the  latter  issue.  Something  wore  nay  be  issued  lately 

1/  Unless  one  wants  to  adopt  the  fosaalities  of  a  utility  theory 
approach  as  in  [68]  and  [69] 

V  See  [68],  [69]  and  [70]. 
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accomplished,  however,  If  the  value*  can  b*  submitted  to 

choice  end  variation.  Thus,  for  instance,  a  range  of  such  values 
alght  also  be  shown  for  Fj  In  this  ease  figure.  K  comparison  aright 
then  be  made  and  a  choice  effected  according  to  whether  the 
probabilities  associated  with  F^  are  preferred  to  those  associated 
with  Fj,"  See,  e.g. ,  [68],  [69]  and  [39]. 


6 .  Cons 

In  soma  cases  we  may  be  concerned  with  probabilities  for 
fulfilling  (or  violating)  one  or  more  constraining  condition.  Here 
the  research  on  chance-constrained  programming  mav  be  of  interest  and 
so  we  proceed  to  point  up  this  topic,  too,  by  reference  to  the  sane 
simple  example.  For  this  purpose,  then ,  we  rewrite  the  constraint 
set  (2)  in  altered  form  as  follows: 


(6)  Fr  [  £  w  a  £t  ]  £  or. 

i»l  1  13  3  3 


Bach  of  these  >1 . .  constraints  is  accorded  interpretations 

like  the  following:  "Pr"  is  an  abbreviation  for  "probability"  and 

evary  0  £  a.  £  1  prescribes  a  level  of  "confidence"  or  "reliability" 

J  1/ 

which— by  reasons  of  "policy,"  "technology etc.  —is  considered 

desirable  on  mission  J.  That  is,  satisfaction  of  any  such  constraint 


Further  development  and  refinement  may  be  found  in [21] 
as  well  as  [51]  and  [52). 


Ill 


790-39)  0-63-8 


requires  ship  assignments  to  be  sufficiently  ed equate  so  that  the 
"risk"  of  falling  below  the  corresponding  difficulty  Index,  t^ ,  will 
be  at  nost  0  £  >  1  -  cr^  £  1, 

A  variety  of  approaches  can  ba  utilised  for  effecting  ship 
4*sigpneiHt»  to  Met  such  chance  constraints.  Depending  on  the 
context,  one  aay  designate  a  class  of  decision  rules  froe  which  an 
optimist  rule  is  to  be  selected.  In  general  one  nay  expect  these 
optimal  rules  to  be  of  a  "conditional  stochastic  variety"--*!*. , 
same  w^  assignments  are  contingently  effected  while  others  are 
wltheld,  or  reserved,  until  the  results  of  preceding  asslgmmnta  can 
be  evaluated;  then  further  w^  assignments  and  evaluations  are 
effected;  and  so  on. 

Such  conditional  stochastic  rules  are  comprehended  under  what 
are  called  the  "higher-order  decision  rulesP*of  chance-constrained 
programing.  These  are  distinguished  from  the  so-celled  "sero-order 
rules"  in  which  the  w^  assignments  ere  ell  effected  ab  initio. 

Ths  latter  class  of  rules  generally  leads  directly  to  e  fractlle 
analysis  for  each  constraint,  as  wa  now  procaed  to  illustrata  for  (i). 
Thus,  refer  to  the  following  figure.  If  the  curve  shown  there  corresponds 
to  sane  function  F^  interpreted  es  the  marginal  distribution  of  a 
random  alemant  t^  than  the  valua  F*1  (ar^)  la  the  frectile 
corresponding  to  ay  That  is,  this  value,  which  la  noted  on  the 
mission  difficulty  scale,  prescribes  the  minimal  effectiveness  rating 
d»ich  tha  ship  assignments,  w^,  must  achieve  if  the  corresponding 

constraint  in  (6)  is  to  bo  fulfilled  with  probability  ay 
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To  continue  in  this  relatively  liaplt  class  of  cases  and  still 
extend  the  scope  of  our  discussion  we  now  replace  the  problem  (3)  by 

minimise  g  a  s  w.  c. 

t»l  1  1 

^  subject  to  m 

Z  *1  *ij  *  FJ 
i»i 

wt  ^  0 

This  is  an  ordinary  linear  programing  problem.  It  Is  also  ealled  a 
"deterministic  equivalent"  for  an  original  problem  with  chance  constraints 
in  tbs  form  (6).  This  term  is  meant  to  suggest  that  (a)  no  random 


terms  appear  in  (7)  and  (b)  any  w.  values  which  optimally  satisfy 


this  deterministic  problem  will  alto  optimally  satisfy  tha  corresponding 
chance -cons trained  problem. 


As  has  just  bean  observed,  (7)  la  an  ordinary  llnaar  programming 

& 

probleat.  Hanca  it  has  a  dual  which  may  ba  writ tan 


dales  s  « 


£  f!1  (Of.)  a. 

J-l  1  J  J 


(•> 


a ub j act  to 


jfi  *U  *J  *  C1 

*j  t  0  • 


Tha  optimal  'a  may  again  ba  used  as  evaluators  but  now  they 
apply  to  tha  fractiles,  fj*  (or^ ) ,  which  are  needed  to  Insure  the 
wanted  reliability  levels.  When  the  figure,  of  merit  Is  as  indicated 
In  (7)--hence  whan  the  criterion  elements  are  stated  in  cost  par  ship 
par  year--th«n  tha  values  represent  tha  related  dollar  evaluations 

that  are  optimally  imputed  to  tha  corresponding  mission  reliability 
levels,  or  j ,  or,  more  precisely,  to  tha  fractlle  values  with  which  they 
are  associated. 

The  s  value  In  (8),  like  the  g  value  in  (7)  Is  stated  in  dollars 


although,  of  course,  tha  criterion  elements  differ  In  that  the  c^  refer 

.1 

to  ship  costs  whereas  the  (a  refer  to  the  fractiles  needed  to  ensure 


U  Of  course,  this  optimality  property  assumes  that  a  aero-order  rule 
is  applicable. 

2/  These  reductions  readily  follow  from  a  more  general  theorem  due  to 
A.  ben  Israel.  See  (  5  ]  and  {  •  J. 


accomplishments  of  the  indicated  ml* alone  st  the  a pec If led  probabilities 


oty  Thua,  In  particular,  the  x^'a  represent  dollar  valuaa  that  are 
implicitly  being  assigned  to  missions,  rather  than  ahipa,  at  the  indicated 
probability  levala  a fy 

In  some  caaea  it  may  be  deairable  to  replace  thaaa  a  valuaa  by 
a  variety  of  non-dollar  indexes.  For  inatance,  we  may  went  an  index 
which  can  be  referred  to  the  original  ef fectivenesa-misaion  difficulty 
acale.  Such  an  index,  which  repreaenta  a  weighted  average  of  the 
already  available  mission  reliability  evaluations,  can  be  developed  as 
follows.  Define  a  set  of  ratios 

x. 


(9) 


r 


± 


J 


n 

t  x. 


<  1 


J-l 


so  that  each  ratio  reflects  the  relative  value  imputed  to  mission  j  by 
the  indicated  assignments.  Applying  these  results  in  a  fairly  obvious 
way,  we  would  then  have  an  overall  index 

®  .1 

(10)  R-  L  F.1  (or.)  r. 

j.l  1  3  3 


which  can  be  referred  to  the  original  0*1,000  scale  to  provide, 

inter  alia,  a  measure  of  overall  syetam  effectiveness  for  the  indicated 

combination  of  missions  at  the  specified  reliability  levels* 

Remark:  Other  poaaibilitiea  might  also  be  entertained  via 
relatively  straightforward  extension)}  of  the  absvo  approach. 

For  inatance  cne  might  proceed  to  maximise  one  or  aura 
combinations  of  system  indicators  while  according  the  related 
dollar  magnitudes  only  the  status  of  e  budgetary 
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constraint.  In  this  connection  It  should  be  of  Interest  to 
note  that  recent  research  has  shown  how  any  ratio  of  linear 
forme  to  be  optimized  (under  linear  inequality  constraints) 
can  be  reduced  and  treated  by  the  swthods  of  ordinary  linear 
programming.  2/ 

He  leave  these  topics  aside,  however,  in  order  to  examine  other 
possible  objectives  which,  inter  alia,  will  also  allow  us  to  indicate  some 
of  the  ways  in  which  higher  order  decision  rules  may  operate. 

7.  Alternative  Objectives: 

As  already  noted,  the  higher  order  rules  of  chance-constrained 

programing  generally  proceed  In  conditional  stochastic  fashion.  I.  a. , 

a  subset  of  w^  values  is  first  designated  and  these  resources  only 

are  committed  until  additional  readings  can  be  made;  then  s  further  subset 

of  w^  values  is  designated  sud  a  new  set  of  readings  obtained;  another 

subset  of  w^  values  is  then  designated  ;  and  so  on.  In  these  cases 

one  ".annot  proceed  directly  to  s  fractlle  formulation  as  in  (7)  and, 

furthermore,  the  objective  must  be  stated  in  a  way  that  reflects  the 

statistical  character  of  the  optimizations  and  related  constraint 

fulfillments  that  are  being  conditionally  pursued. 

The  possibility  of  a  rather  wide  choice  of  objectives  is  thereby 

opened  and  thus  there  is  also  opened  a  corresponding  range  of  choices 

among  cost-ef fee ti veneer  measures  and  related  evaluations.  We  Illustrate 

3/ 

some  of  these  possibilities  as  follows. 


y  The  dual  evaluators  associated  with  such  constraints  would  than 

have  the  character  of  imputed  rates  of  interest.  See,  e.g. ,  [  12  ] 
Chapters  XV  and  XVII.  Sea  also  B.  M.  Wsingartnar  [  73  ]  as  wall 
as  B.  gasluad  and  A.  Whins  ton  [  32  ]. 

If  I.  e,  by  reference  to ‘ordinary  linear  programing  "equivalents”  of  these 
nonlinear  models.  Sea  [14]  San  also  [15]  for  further  references. 

3/  See  [  11  ]  from  which  these  materials  have  bean  extracted. 


Cue  i:  "E  Model. "  For  this  aodel  the  figure  of  merit  g 
la  defined  by  reference  Co 

<lt>  >  *  «!  cA 

where  "E"  means  "expected  value. "  An  associated 
optimization  then  proceeds  with  respect  to  this 
figure  of  merit  g  as  thus  defined. 

Remark  1;  Although  such  "expected  value  optimizations" 
have  often  been  criticized,  1 /  they  have 
nevertheless  been  widely  employed.  If 
The  point  of  many  of  these  criticisms  bears 
on  the  fact  that  in  many  situations  reference 
must  be  made  to  "risks"  which  emanate  from 
"skewness"  and  other  such  properties  of  the 
pertinent  statistical  distributions.  3/ 

Remrrk  2;  Some  protection  against  the  full  force  of 

these  criticisms  can  be  secured  by  flexible 
use  of  the  constrained  optimizations  being 
considered  here.  Thus,  for  Instance,  one 
might  introduce  associated  penalty  terms  in 
the  functional  as  is  done  in  linear  programing 
under  uncertainty,  for  instance.  4/  Alternatively 
one  can  introduce  constraints  which  beer  on 
the  allowable  amounts  of  risk  and  refine  these 
controls  in  e  variety  of  ways.  For  instance, 
one  may  replace  any  t  in  (6)  by  e  new 
A  J 

random  variable  tj  ■  kj  +  *j  <r, 

to  indicate  that  only  e  certain  proportion  of 
this  value  is  to  be  considered,  plus  a 

further  term  which  is  additive.  5/  Also,  one 


U  See,  e.g. ,  [4]  p.  39,  for  e  summery  discussion. 

2/  See,  e.g.,  G.  B.  Dantzig  [29  ]  end  G.  B.  Dantzig  and  A.  Madansky  [  30  ] 
for  auch  objectives  at  utilized  for  "linear  programming  under 
uncertainty." 

3/  Sea,  howevar,  the  discussions  In  Chapter  6  of  [38]. 

4/  Tide,  e.g. ,  [29  ]  and  [30  ],  See  also  the  paper  [  22]  for  further 

illustrations  aa  well  as  a  demonstration  that  all  tvo-stage  models 
of  linear  programming  under  uncertainty  can  ba  reduced  to  a  single 
type  of  deterministic  equivalent* 

5 f  One  cm  also  permit  these  proportionality  factors  to  ba  selected  me 

~  e  pert  of  the  optimisation.  See,  e.g. ,  C.  Tan  de  Panne  and 

v»  Popp 7.1  _] » 


can  Iterate  any  constraint  to  allow 
for  still  further  controls  by  assigning 
different  Oj  values  to  each  constraint 

in  Che  indicated  iteration.  1/  Finally, 
of  course,  one  can  combine  penalty-tens 
approaches  with  these  constraint  alterations 
and  also  introduce  still  further  constreints 
for  their  contrd-and-evaluation  possibilities*  2) 

Case  ii:  "V  Model":  In  same  cases  we  may  be  concerned  with  an 
overall  "risk  minimisation."  One  such  approech  would 
proceed  via  the  so-called  mean-squere  error  defined  by 

*  a  o  2 

(12)  g  *  *  E  (w  c.  -  w®  c?) 

i-1  1  1 


wherein  the  w®  c°  represent  some  set  of  "preferred 

values."  Minimisation  of  the  figure  of  merit  g  would 
than  correspond  to  risk  minimizations  of  the  kind  that 
sura  sometimes  utilized  in  selecting  investment  portfolios 
and  also  (with  suitable  criterion  elements)  the  kinds  of 
optimizations  that  ere  sometimes  pertinent  for  the  design 
or  operation  of  complex  engineering  systems. 

Remark:  Optimisations  such  as  (12)  may  be  undertaken  in 

their  own  right  or  else  they  may  be  undertaken  lit 
conjunction  with  chance  constraints  In  the  form 
of  (6).  Some  progress  has  been  mads  in  achieving 
deterministic  equivalents  for  the  letter  class  of 
cases.  See  [  11].  Further  research  is  also 
needed  to  obtain  insight  on  where 
such  obj act ive-and -constraint  combinations  a my 
best  be  employed.  4/  thus,  for  instance,  one 
might  wish  to  continue  with  an  "E  Model"  subject 
to  e  risk  constraint  of  the  fora 


\)  See  [11],  p.  21,  for  further  discussion. 

2 f  See,  e.g. ,  [  13]  for  an  example  where  an'liorizon  constraint  "is 

introduced  to  evaluate  the  time  interval  over  which  a  tanker-fleet 
acquisition  program  is  being  considered. 

1/  See,  e.g. ,  [4*]. 

4/  See,  for  Instance,  the  remarks  by  Neslund  sad  Whins ton  [32  ) 

for  the  risk-control  end  evaluation  possibilities  of  an  "E  Model" 
in  an  investment  analysis. 


n8 


(13) 


S 


£ 

1-1 


<«l  ct 


wh«r*  g  is  some  fixed  value  --and,  of  course, 
still  other  possibilities  ere  present. 

Case  iii:  "P-Modsl".  In  this  approach  one  might  continue  with  the 
constraints  (6)  and  then  orient  the  figure  of  merit  toward 
an  cr  value  as  in 

m  m 

(14)  Of  ■  h  [  £  w  c  <  £  »?  c?  ] 

i-1  1  i-i  1  1 

and  then  proceed  to  "maximize  or"  as  the  objective* 

Remark  1:  It  is  of  interest  to  observe  that 

recent  research  }J  has  shown  how  to 
obtain  deterministic  equivalents  for  the 
objectives  (11) ,  (12)  and  (14)  and  that, 
for  the  statistical  distributions  stjdled, 
the  deterministic  equivalents  of  the  former 
pair  both  appear  as  constraints  in  the 
deterministic  model  that  appears  as  the 
equivalent  for  the  maximization  of  (14) 
under  chance  constraints* 

2;  By  adding  further  constraints  to  (6) 
in  such  forms  as 

(15)  Pr  [  £  wfc  ck  ^  £  w®  cj  )  £  or# 

it  is  possible  to  make  contact  with  the 

"satisficing  objectives"  introduced  Into  the 

behavioral  sciences  and  organization  theory 

literature  by  B.  A.  Simon.  2/  Such  additional 

constraints  are  needed  to  invoke  the  search 

mechanisms  that  Simon  prescribes  when,  for  instance, 

max  of  <  or  or  then  some  of  the  constraints 
o 

in  (15)  ere  not  compatible  with  others  of  the 
fora  ((). 


1/  Sea  III  ]. 

2/  See  e.g. ,  Chapters  14  and  15  in  (61]  as  wall  as  the  article  (62) 
by  E>  A*  Simon* 
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Cu>  ivt  "G  Models."  These  are  generalizations  of  tha  (multi¬ 
dimensional)  goal -programming  modal*  of  ordinary 
linear  progx earning.  \J 


A.  One  such  approach  Involves  penal ty-aad -reward 
features  which  awy  be  suitably  associated  with 
soma  subset  of  tha  constraints  (6).  2/ 
for  instance,  ve  may  define  new  variables 


and  by 


s  of  the  relations 


+ 

*k 


1  for  £  v  a  k  *  \ 
1-1  1  1K  * 


(1*> 


0  for  I  »J  .lk  s  H 
i“l 


0  for 


£  *1  *il  2  *k 


i,1  £“  £  ”l  *ik  S  H 


and  then  attain  a  corresponding  scalar  optimisation 

as 

(17)  min  *EB(£rk*£-Pk*j[> 

where  rfc  and  p^  are  the  relevant  penalties 

and  rewards  for  satisfying  (or  failing  to  satisfy) 
the  constraints  indexed  by  k. 

B.  Another  approach  proceeds  directly  to  a  Joint 
maximisation  as  in 

a 

(18)  maximise  or  •  Pr  {  £  vtslk^t.) 

i-1  1  * 


\f  I.a. ,  models  in  which  constraints  are  incorporated  in  tha  functional 
with  the  objective  being  oriented  toward  "coming  as  dose  as 
possible  to  meeting  ell  of  the  Indicated  foals.”  Sea  Appendix  I 
and  Chapter  Z  in  [  12]* 

2/  This  builds  on  work  published  by  A.  Charnes  amd 
””  e.g. ,  (25  j  and  (  26].  tee  also  (  27]* 


A.  Btedry.  Bee, 


vbir*  the  brae* a  lndlcata  that  this  auialsitlM 
ia  to  ba  jointly  undertaken  ovar  all  the 
constraints  indexed  by  k. 

C.  Still  aaothar  approach  la  via  a  "max lain  objective" 
as  In 


maxiaiaa  or 
aubjact  to 

(H)  « 

with,  of  eouraa,  atill  othar  conatrainta  in  tha 
fora  (6)  to  ba  conaldarad.  finally,  of  eouraa, 
ona  could  evidently  replace  this  by  a  weighted 
eoobinatlon  of  tha  form 

(20)  maximise  g  -  £  rk 

which  then  becomee  an  alternative  expected  -value 
optimisation  with  constraints  in  the  form 

(I1>  tr  C  £  *,  ^  ]  •  «, 


where  these  0  <  a;^  <£  1  are  variables  to  be  chosen 
subject  perhaps  to  ancillary  conditions  such  as 

(22)  a 


then  relative  (probabilistic)  preferences  are 

thus  to  be  accorded  the  missions  to  which  they  are 

related.  When,  further,  no  mission  probability  is 

to  ba  permitted  to  fall  below  a  prescribed  level, 

or  ,  we  can  also  write 
o 

(23)  *  «e  » 


y  Observe  that  any  w^  assignment  fixes  the  maximum  attainable  a 
at  a  level  corresponding  to  the  lowest  probability  which  is  them 
assigned  to  any  ona  of  these  k  constraints,  lance  tha  term 
"marlnin  obj active"  is  aypropriatni 
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and  thereby  assure  that  the  Maximization  in 
(20)  is  not  purchased  at  an  unacceptable  level 
of  risk  for  any  of  the  indicated  Missions. 


The  above  suggestions  are  not  exhaustive.  There  are  nany 
possibilities.  In  the  "C  Models”,  for  Instance,  we  have  Illustrated 
sens  of  the  joint  constraint  possibilities  relative  to  the  objectives. 

y 

We  can  also  introduce  "joint  constraints"  per  se  in  such  forns  as 

a 

(24)  Pr  (  E  w  a..  £  t.  )  £  or 

ksK  i-1  1  * 

where  now  all  kil  of  the  indicated  constraints  are  to  be  jointly 
satisfied  at  sons  prescribed  level  0  £  a  £  1.  For  instance,  if 
K  -  {1,  2}  than 

M  MM 

**  f  E  wi  *ik  *  *J  "  t  E  *a  £  t  *  E  Wi  *12  *  *2  *  *  * 

ksK  i-1  1  k  i-1  1  11  1  i-1  1  12  2 

is  the  pertinent  condition  and  the  w^  assignment  must  jointly  satisfy 
this  constraint  with  probability  of  at  least  arlOOX* 


y  Cf.  t  72) 
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8.  K-Efficlsncv  and  Multiple-Objective  Optimizations  ip  Dsterminlstlc 

The  above  characterizations  provide  entrances  to  various  ways  in 
which  multiple  objective  approaches  night  be  used  In  association  with 
chance-constrained  programming.  It  will  help  to  make  natters  somewhat 
more  clear,  however,  if  we  do  not  proceed  directly  to  the  latter  topic 
but  enter  it  rather  by  neons  of  only  deterministic  characterizations 

y 

which  we  have  elsewhere  called  by  the  none  of  X-affleiancy. 

To  introduce  these  concepts  we  may  suppose  that 


(25) 


£  *1  *lk  '  Tk 


defines  a  distinguished  set  of  Indices  among  the  set  J-l,  ,  n 
in  (3).  Each  such  nay  be  Interpreted  as  a  measure  of  effectiveness 

for  the  mission  with  which  it  is  associated.  For  ease  of  exposition 
we  may  suppose  that  these  k  indexes  are  applicable  to  the  first  K 
constraints  in  (3). 

We  want  an  optimization  that  avoids  assumptions  of  coaq>arsbllity 
between  any  of  these  effectiveness  measures  end  this  is  done  by  omens 
of  X  efficiency  as  follows.  Let 

(2b)  T  *  (T^i  •••»  Tg) 

so  that  T  is  a  vector  in  which  comparisons  con  be  made  only  between 

A  A 

elements  in  the  some  position.  Thus  T  •  T  if  and  only  if  for 


£/  After  Tjelling  Koopawns  who,  at  an  early  date,  showed  how  these  ideas 
of  "Pareto  optimality"  could  be  formulated  in  tarns  of  so-called 
"activity  analysis  models. M  Sea  [42]. 
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•v*ry  H,  ....  I  «ad  T  £  T  If  and  only  If  4  £  for  each 
individual  index  fc. 

y 

Hov  conaidar  tha  problem 


ifl  *lk  "  *k  *  *•*  •  * 


(27) 


Wi  *ij  *  *  J  *  ^mMhl  ’  ' *  *  *  ■ 


1-1 


ri  ci 


SC 


^  0 1  i— 1  •  •  •  •  i  a 


and  aupposa  that  a  aat  of  valuaa  w  satisfies  all  constraints  and 

A  A  A  A 

produces  a  vector  of  values  T  -(T^ ,  ....  Tfc,  ....  This  vector 

is  "efficient”  (or  "optimal")  if  and  only  if  there  is  no  other  w  . which 
also  satisfies  all  constraints  and  produces  a  vector  of  objective  values 
I  -  (Tj >  • « •  »  ,  Tj,}  with  the  property 


(28) 


A  ,  A 

T*T.  T  +  T. 


this  is  to  say  that  T  is  not  efficient  if  another  vector  T  can  be 

y 

found  with  the  following  2  properties:  (1)  no  coaponent  of  T  has  a 
smaller  value  than  its  corresponding  couponent  in  T  end  (li)  at  least 
one  coaponent  in  T  is  greater  than  its  corresponding  component  in  *T. 


y  We  have  here  replaced  the  objective  (1)  with  a  budgetary 
constraint  limiting  expenditures  to  a  max  heal  value,  C. 


2/  Xt  la  assumed  that  all  constraints  are  also  satisfied  by  the 
solution  v  associated  with  f. 
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H> 


Bearing  the  significance  of  these  non-comparability  assumption* 
in  Bind  we  can  nevertheless  formulate  e  corresponding  linear  progrsMLing 
problem  in  the  following  form 


K 

Z 

ts>l 


*k 


subject  to: 


E  W1  *ik  “  Tk 
1-1  R 


m  0  ,  k“l  i  • s • |  K 


(29) 


£  *1 
i-1 


£  tj  ,  J-l,  Bfrl,  ,  n 


E  "i  Ci 
i-l  1  1 


SC 


-  *k  -  Ifc  ,  h^i.  ....  1 


wherein  w^  >  0  all  1  end  £  0  ell  k.  He  can  then  observe  the 
a  A 

following:  (1)  T  with  components  will  be  efficient  if  and  only 

A 

If  max  z  m  £  z.  *  0.  Furthermore,  If  T  Is  not  efficient  then  the 

*  1/ 

solution  associated  with  will  be  efficient. 

He  can  see  this  readily  enough  if  we  observe  characteristics  like 

the  following:  r*  >  0  can  only  occur  If  some  a*  >  0.  But  this  In  turn 

A 

implies  that, for  this  same  k, for  the  same  indices  k.  On  the 
A 

other  hand  is  the  only  other  possibility  since  every  is 

A 

constrained  to  be  non-negative.  Hence  s*  -  0  implies  every  k 

A 

and  evidently  T  is  efficient  since  otherwise  **  •  0  would  not  be 

maximal. 


y  Cf.  Chapter  XX  in  [12]  for  ths  relevant  theorem*  and  proof*  a*  wall 
as  an  algorithm  (the  "spiral  method")  for  locating  all  such  efficient 
points. 
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Although  a  scalar  objective  has  ban  utilised  la  (29)  this 
should  only  be  regarded  as  an  artifact  for  purposes  of  analysis  (proof) 

A  A 

and  computation.  For  instance,  if  two  different  vectors  T  and  T  ware 

*  $ 

specif lad  which  produced  values  t*  and  t*  which  ware  both  non-sero 

than  one  could  only  say,  in  general,  that  neither  was  efficient.  The 
a  * 

fact  that  s*  >  z*  >  0  should  not  be  automatically  accorded  any 
significance.  The  comparison  is  only  with  reference  to  efficient 

A 


possibilities  as  when,  for  instance,  T  has  some  components  which  are 

2 

larger  and  some  which  are  smaller  than  their  corresponds  in  T. 

A  * 

Similar  remarks  apply,  of  course,  to  the  cases  in  which  T  and  T 

are  both  efficient  and,  indeed,  one  may  generally  expect  many  such 

1/ 

efficiency  possibilities  in  a  realistic  problem.  Direct  comparisons 
between  such  efficient  solutions  is  not  possible  without  recourse  to 
supplementary  criteria.  On  the  other  hand,  all  such  efficient  solutions 
will  be  optimal  in  the  sense  that  one  cannot  improve  any  in  an 

efficient  T  without  worsening  one  or  more  of  its  other  components. 

y  a  a 

Thus,  on  the  "design  side"  when,  say,  T  specifies  a  set  of  values  T^, 

one  for  each  objective,  then  one  can  be  sure  of  the  following  when  a 

i*  is  secured  vie  (28):  (i)  the  solution  associated  with  z*  is  efficient, 

A 

(11)  no  design  specification  T.  is  violated,  end  (ill)  the  trade>off 

“  31 

terms  for  any  other  efficient  possibilities  can  be  readily  ascertained. 


\f  See  preceding  footnota. 

2 /  In  the  sense  of  the  stage-one  and  stage-two  and  intermediate  stage 
character last ions  that  were  discussed  in  section  2,  above. 

2/  g.g. ,  via  a  dual  evaluator  analysis  of  the  kind  discussed  In 

section  4.  See,  however,  Chapter  SC  in  [12]  for  further  possibilities 
that  may  eleo  be  need. 
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Thus,  le  particular,  that*  trade-off  peaalbilltelea  arc  optimal  la  the 
already  Indicated  eeneaa. 
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9.  Functional  Ffftctency  and  Multtple-Ob lecMve  Opt imlta  tions  for 
Chance-Constrained  Models: 

To  deal  with  raultlple-objectlves  in  chance-conatrained  problwns  it 
is  necessary  tc  extend  che  above  ideas  and  so  we  therefore  invoke  the 

y 

more  general  ideas  of  functional  efficiency.  Por  this  purpose  we 
introduce  1 ,  ...»  R  functions 

(29)  Fr  (T1,  ....  Tr) 

which  may  each  represent,  say,  a  "utility  function"  or  some  other 

suitable  indicator  of  satisfaction.  Again  we  do  not  wish  to  admit 

direct  comparisons— at  least  until  a  "functionally  efficiency"  point 

has  been  achieved  so  that,  then,  we  may  be  assured  of  optimality  in 

each  such  dimension  before  proceeding  to  a  trade-off  analysis. 

Hence  proceeding  to  extend  the  analysis  which  has  Just  been  given  we 

2 

have  recourse  to  an  analogous  artifact  and  write  our  problem  in  the  form 

R 

max  z  ■  E  z 
1*1  1 

subject  to 
m 

,E,  ”t  *u  •  Tk  ■ 0 


,f,  *i  *u 


L  *,  «t 


^  (T  ^ » •  •  •  ,  ,  ...  —  zr  •  f^  (T^  ,  •  •  •  ...  ,T^) 


w^  ^  0,  i*  1 »  ■ 

^  0,  p- 1 ,  * • * ,  R* 


y  Also  called  "f j-efficiency."  See  Chapter  IX  in  [12]  where  these 
ideas  vexe  Li  rat  presented. 

2/  Giving  a  multi-dimensional  utility  optimization,  if  one  Is  wanted. 


Evidently ,  again,  max  t  ■  t*  ■  0  if  and  only  if  T  •  «i . 1 . V 

is  "functionally  efficient."  ^ 

We  need  not  here  elaborate  further  on  these  ideas  of  functional 
efficiency  per  se  since  our  purpose  is  rather  to  utilise  these  ideas 
in  formulations  like  the  following: 


max  s  ■ 


(31) 


subject  to 

m 


* 

scS 


*  "l  *lj  2  lj>‘  '•  *° 


V 


where  the  chance  constraints  (which  may  perhaps  be  joint)  that  we  have 
here  singled  out  for  attention  all  have  their  erg  values  as  variables 
to  be  optimally  determined  subject  only  to  0  £  a*  £  1.  To  be  sure, 
there  will  normally  be  other  constraints  with  fixed  Oj  values.  The 
point  is,  of  course,  that  this  is  Intended  as  an  extension  to  a  multiple* 
goal  formulation  in  a  probabilistic  context  which  we  now  readily  achieve 
by  requiring  ^  0  for  all  s«8. 

In  some  canes  we  may  with  to  consider  preemptive  priority 

possibilities  in  which ,  say,  mission  is  of  paramount  importance. 

We  handle  this  by  means  of  the  artifact:  M  »  M  whenever  s.  >  s, 

*1  *2 


by  which  ve  mean  there  is  no  number  k  with  the  property  £  M  . 

~~  *2  *1 


y 


1/  Mote,  however,  that  this  does  not  then  require  T*  •  T  as  in  (29). 

2/  Cf.  (24)  ff.  See  elso  [72].  We  are  here  omitting  cost  snd  other 
~  constraints  (deterministic  or  not)  which  would  be  needed  to 
complete  these  models.  See  (28)  and  the  footnotes  on  p.  17. 

3 J  X.  e. ,  these  M  values  have  the  so-called  non -sr chimed 

property.  8ee,  e. g. ,  pp.  754  and  passim  in  [12]. 
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Then  we  write 


oex  *  ■  £  M  ar 

•js*  *J  J 

(32)  subject;  to 

a 

Pr  f  i  wi  *11  ^  ei*  *  ®s 
i-1  j  J  J 

end  require  only  0  <  a  <  1,  ell  s.eS.  Again  we  leave  these  or  values 

"  “j  "  J  J 

to  be  determined  by  the  optimizing  choices  of  w  relative  to  the  preemptions. 

To  help  underscore  the  significance  of  (31)  we  observe  that  some 
lower  ranking  or  may  be  accorded  values  a  -  0.  Indeed,  even  very 

■j  J 

large  increases  in  these  or  may  be  foregone  if  any  such  increase  must 

“j 

be  purchased  at  the  cost  of  even  a  very  small  decrement  in  any  mission 
which  has  a  higher  preemption  index. 

Such  preemptions  may  be  too  strong  for  many  applications.  But 
then ,  of  course,  it  Is  possible  to  combine  (31)  and  (32)  in  a  variety 
of  ways  or  else  to  proceed  directly  to  minimum  stipulations  on  pertinent 


missions  as  in  the  following: 


(33) 


max  z  ■  £  M  6 

•j«S  j  J 

subject  to 

Pr  {  £  w  a  £  t  }  -  or  ^  0 

i-1  3  *J 


where,  ae  in  (31),  5  £  0,  also  appllaa. 

*  a 
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10.  Conclusion: 

We  heve  now  surveyed  a  variety  of  possible  approaches  to  cost* 
effectiveness  that  might  be  secured  from  the  models  and  methods  developed 

y 

in  recent  research.  This  survey  has  not  been  exhaustive  and,  indeed, 
we  have  not  even  covered  all  of  the  possibilities  even  from  chance* 

y 

constrained  programming. 

In  all  except  the  last  preceding  section  we  have  attempted  to 
supply  evaluations  for  possible  use  (including  computational  feasibility) 
along  with  our  delineations  of  the  possibilities  that  are  now  open. 

Further  research  on  methods  of  computation  for  these  nonlinear  modals 
will  probtbly  be  needed.  On  the  other  hand ,  this  need  not  be  en 
impossible  barrier  to  immediate  use  in  all  cases.  Notice,  for  Instance, 
that  the  preemptive  priority  model  (32)  admits  of  an  approach  like  the 
following:  Conmence  with  the  objective  that  has  highest  priority.  Assign 
all  available  resources  to  this  objective  until  a  maximum  probability  la 
achieved.  If  any  resources  remain,  proceed  to  the  next  preemptively 
ordered  objective  and  assign  the  remaining  resources  to  It.  Check  these 
assignments  by  examining  whether  alternative  allocations  will  permit  an 
increase  in  the  latter  without  producing  any  decrease  in  the  former. 
Continuing  in  this  manner  one  may  expect  to  deal  in  general  with  only 
a  few  such  objectives  at  beat. 

1 J  p.g. ,  we  have  not  adequately  attended  to  all  of  the  possibilities 

from  stochastic  linear  programing  and  we  heve  only  barely  mentioned 
the  topic  of  linear  programming  under  uncertainty. 

2/  for  instance  we  have  not  really  explored  die  possibilities  for 

Bamark  *1  under  Case  1  in  section  7  and ,  in  particular ,  we  heve  not 
explored  the  possibilities  cf  joint  determinations  for  tj  and  or,. 
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We  uy  elso  note  thet  analogous  remark*  apply  for  (33)  anA  that 
even  in  the  more  difficult  ceae  of  (31)  the  ar(  value*  are  likely  to 
be  felrly  high.  Thi*  meins,  in  particular,  that  one  will  generally  be 
confined  to  exploring  on*.y  small  regions  in  the  tells  of  the  associated 

y 

statistical  distributions. 

We  have  elso  mentioned  the  possibility  of  different  objectives 
along  with  the  different  evaluations  that  may  result  even  when  the 
corresponding  optimal  solutions  are  at  hand.  See  section  7.  Similar 
renarks  elso  apply  to  the  models  covered  in  section  9  along  with  their 
resulting  trade-off  possibilities.  Thus,  unless  a  correct  objective 
(nail ti -dimensional  or  otherwise)  has  been  specified  one  stay  not  have 
the  "correct"  t  ie-off  possibilities  even  after  an  optimum  has  been 
attained.  On  the  other  hand,  this  need  not  be  decisive.  Thus,  as  in 
the  case  of  the  B-objective— see  section  7  —the  possibility  of 
constraint  adjunctions  should  not  be  overlooked.  The  possibility  of 
model  equivalences  (even  with  different  objectives)  should  elso  not  be 

y 

overlooked.  Thus,  even  with  completely  different  objectives  two  different 
models  may  be  equivalent  in  the  sense  thet  they  lead  to  exactly  the  seme 
decision. 

This  is  all  by  way  of  saying  thet  (e)  the  letter  topics  are  elso 
in  need  of  further  research  end  (b),  in  any  event, ^ork  in  ’model 
synthesis  offers  a  fruitful  way  to  clarify  objectives  in  actual 
applications. 

y  Cf.  the  remarks  in  [-21j  for  their  bearing  on  "meaningful"  policy 
conditions.  See  also  the  algorithms  d locus sad  there. 

2/  See  the  concluding  remarks  in  [11].  See  also  [16]  end  [12]. 
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It  thus  •  santa  approprlata  to  conclude  by  observing  that  there  le  now 
a  need  for  the  Insight  that  can  only  be  oKtatned  front  research 
conducted  on  such  "probabilistic"  models  In  the  context  of  actual 
military  problems.  So  far  as  we  know  only  one  such  piees  of  research 
has  been  reported  to  dste.  This  was  the  research  directed  toward  the 
evolution  of  e  multi-dimensional  objective  model  of  e  chance -cons trained 
variety  that  could  be  used  as  a  guide  for  the  1HAS  (Integrated 

V 

Helicopter  Avianlcs  System)  designs  under  U.  S.  Navy  auspices. 


1/  Under  Bureau  of  Bevel  Weapons  Contract  Bo.  BOv  64-01 36c.  A  published 
summary  of  this  nodal  and  its  suit  1 -dimensional  objectives  any  ha 
found  in  [It]. 
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THREE  LEVELS  OF  ANALYSIS  OF  COST-EFFECTIVENESS 
ASSOCIATED  WITH  PERSONNEL  ATTITUDES  AND  ATTRIBUTES1 

Bernard  M.  Bass,  Walter  P.  McGhee  and  James  A.  Vaughan 
Graduate  School  of  Business 
University  of  Pittsburgh 


The  manager  of  any  productive  or  service  organization  must  see 
himself  as  a  systems  balancer  (Bass,  19 6j).  If  he  tries  to  maximize 
one  particular  output,  say,  immediate  cash  profits,  or  minimize  some 
particular  input,  say,  equipment  costs,  he  is  likely  to  run  into 
trouble.  For  instance,  his  get -rich-quick  efforts  may  inhibit  the 
satisfactory  maintenance  or  growth  of  his  operations  or  generate  labor 
unrest;  his  minimization  of  equipment  expenditures  may  reduce  the  flexi¬ 
bility  of  his  operations,  again  produce  dissatisfied  personnel  and 
interfere  with  the  quality  of  products  and  services. 

As  he  tries  to  balance  his  system,  the  manager  must  deal  with  a 
multiplicity  of  inputs  and  outputs.  In  doing  so,  he  seeks  to  satis 
on  numerous  objectives.  Thus,  in  "off-the-record"  interviews,  75  per¬ 
cent  of  150  chief  executives  or  their  assistants  mentioned  more  than 
one  goal  when  asked,  "What  are  thj  aims  of  top  management  .vs  your 
company?"  One-sixth  mentioned  more  than  three  goals.  They  wlked  about 
growth,  service,  good  products,  making  money,  employee  welfare,  and 
so  on  (Dent,  1959/* 

If  we  wish  to  evaluate  organizations  involving  the  interplay  of 
men,  money  and  materials,  organizations  whose  objectives  are  multiple, 
we  must  measure  organizational  performance  on  a  series  of  dimensions 
involving  human  and  material  as  well  as  monetary  outputs.  In  the  same 
way.  If  the  cost-effectiveness  of  different  organizations  are  to  be 
compared  (or  the  same  organizations  over  time  are  to  be  studied),  then 
human,  material  and  monetary  costs  need  to  be  taken  into  account.  Again, 
multiple  cost-effectiveness  indices  will  be  required  with  multivariate 
analyses  of  these  indices  to  further  understanding  of  the  measures  used. 
The  single  business  firm  can  be  studied  at  different  points  in  time  or 
as  will  be  illustrated  in  this  presentation,  by  multivariate  compari¬ 
sons  with  other  business  firms. 

Analysis  can  proceed  at  three  levels.  Simple  correlational  anal¬ 
yses  of  the  raw  interacting  financial,  material  and  human  resources 
may  provide  a  surface  empirical  description  cl  '•he  multiple  associa¬ 
tions  involved.  The  next  and  probably  most  popular  level  of  analysis 
can  be  based  on  the  interrelations  among  derived  indices.  Care  must  be 
taken  here  to  avoid  artifactual  correlations. 2  But  an  even  more  abstract 
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level  of  study  can  be  achieved  by  means  of  factor  analysis  which 
isolates  a  minimum  number  of  fundamental  dimensions  underlying  the 
surface  correlations  among  the  financial,  material  and  human  inputs 
and  outputs  among  the  systems  under  examination.  With  such  factorial 
dimensions,  ve  can  describe  the  differential  patterns  which  appear 
for  different  companies .  Instead  of  evaluating  cost-effectiveness  of 
i  firm  on  some  single,  simple  good-bad,  healthy-unhealthy,  profitable- 
unprofitable  or  high  cost-low  cost  measure,  we  become  able  to  describe 
how  a  particular  firm  departs  from  the  average  foi  all  conpanies  under 
study  on  some  minimum  fundamental  set  of  dimensions  accounting  for  the 
common  covariance  among  the  companies  on  the  multiple  asses smenxs 
employed. 

Our  purpose  here  was  to  apply  the  three  levels  of  analysis  to 
studying  the  interrelations  among  selected  financial,  material  and 
sociopsychological  measurements  of  the  performance  of  28  firms. 


Basic  Variables 

Financial 

The  fiscal  reports  of  28  manufacturing  companies  provided  sales 
and  cost  data  from  which  to  evaluate  the  differential  effectiveness 
of  the  companies.  The  companies  produced  a  variety  of  competing  items 
for  a  common  market  with  about  the  same  numbers  of  employes,  plant  and 
capital.  A  company's  market  demand  depended  on  how  much  more  it  ad¬ 
vertised  than  its  competitors  and  how  much  lower  its  prices  were  on 
each  of  the  items  it  produced.  The  usual  production,  sales  and  cost 
figures  were  obtained  for  the  reports  of  the  28  companies. 

Attitudinal  Variables 


Just  before  the  fiscal  reports  became  public,  a  survey  had  been 
completed  of  the  attitudes  of  company  managements  towards  various  issues 
about  company  operations.  A  parallel  survey  had  been  conducted  among  the 
workers  within  each  of  these  companies. 

The  13  questions  to  which  managers  and  workers  responded  were  as 
follows : 

1.  To  vhat  extent  are  you  satisfied  with  the  job  you  have  been 
assigned? 

2.  To  what  extent  is  it  easy  to  sell  others  in  your  company  on 
new  ideas? 

3.  To  what  extent  is  it  easy  to  be  open  in  expressing  your  real 
feelings  on  how  operations  are  being  conducted  without  being  regarded 
as  disloyal? 


4.  To  what  extent  are  you  satisfied  with  your  company's 
operations? 

5.  To  what  extent  are  you  satisfied  with  your  inanedlate  boss? 

6.  To  what  extent  is  there  overlapping  of  responsibility  or 
duplication  of  effort? 

7.  To  what  extent  are  you  satisfied  with  your  subordinates? 

8.  To  what  extent  are  you  clear  about  the  goals  of  your  Job? 

9.  To  what  extent  do  you  have  an  opportunity  to  make  your  own 
decisions  rather  than  have  them  made  for  you  by  others? 

10.  To  what  extent  do  you  have  authority  to  make  decisions  which 
natch  your  responsibility? 

11.  To  what  extent  are  there  upward  communication  failures  in  the 
company? 

12.  To  what  extent  do  you  feel  caught  in  conflict  of  interests  with 
other  members  in  your  company? 

13.  To  what  extent  are  decisions  in  your  company  made  entirely  by 
indivi  iualc  at  the  top  of  the  organisational  hierarchy,  by  individuals 
located  at  all  levels  in  the  organization,  by  shared  decision-making 
process- js  cn  on  informal  basis,  by  small  groups  at  the  top  of  the  hier¬ 
archy  ox  by  groups  representing  all  levels  within  the  organization? 

For  each  question,  except  the  last,  the  individual  respondent  could 
nsewr-r  using  a  nine-point  scale:  9»  A  great  deal;  8.  Very  much; 

'.  5airly  much;  6.  More  than  some;  5.  Some;  U.  More  than  a  little; 
j.  A  little;  2.  Hardly  at  all;  1.  Not  at  all.  A  modified  scale  was  used 
r  the  Jaet  question. 

lb.*  mean  altitude  on  *ach  of  13  issues  of  the  management  and  of 
\h  force  was  calculated  for  each  company. 


-nm-l  Variables 


b  ~r..  .--I  records  made  possible  calculations  of  the  mean  intelligence, 
p  .  sjrai  .  i.-nte*  I-.ns,  age  ai.d  work  experience  of  both  groups  within  each 
•r  r .  Tr  r  p.-r  >  ..el  •  ere  extracted  verbal  and  ns-’erical  aptitude 

sc  \r f  .•  »r  the  neuagerc  worker:,  within  oacn  company;  their  age 


and  months  of  work  experience  were  also  obtained  from  these  files 
along  with  their  scores  on  a  scale  of  attitudes  towards  management 
and  labor.  A  high  score  indicated  a  pro-labor  attitude;  a  low  score 
was  suggestive  of  a  more  conservative  pro -management  position.  The 
scores  of  these  managers  and  workers  on  an  Orientation  Inventory 
(Bass,  1962)  yielded  assessments  of  these  individuals  on  the  extent 
to  which  they  were  self-,  interaction-  or  task-oriented.  (A  person 
high  in  self -orientation  is  rewarded  by  recognition  and  admiration 
from  others;  &  person  high  in  interaction -orientation  is  likely  to 
be  primarily  rewarded  by  opportunities  for  having  satisfying  rela¬ 
tions  with  others  in  the  organization,  while  the  task-oriented  person 
is  primarily  pleased  by  opportunities  for  challenging  jobs  which  he 
can  complete  successfully.  The  task-oriented  person  is  most  likely 
to  persist  in  the  face  of  failure.) 

As  before,  the  mean  values  for  the  managers  of  a  particular 
company  and  the  mean  values  for  the  workers  of  a  particular  company 
were  calculated.  These  means  were  then  correlated  with  cost-effective¬ 
ness  und  financial  performance  data  for  each  of  these  companies. 

Over  50  basic  financial,  social  and  psychological  variables  were 
collected  for  each  of  the  28  companies. 


Methods  of  Analysis 


Raw  Data  Level 


Three  levels  of  analysis  were  completed.  First,  we  studied  the 
matrix  of  the  product -moment  correlations  among  52  variables.  For 
Instance,  Tables  1  and  2  show  portions  of  this  matrix.  Table  1  dis¬ 
plays  the  correlations  between  the  panel  of  financial  variables  with 
the  panels  of  mean  attitudes  held  by  the  managers  and  workers  of  the 
same  companies.  These  simple  correlations  reveal  which  raw  fiscal 
data  appears  to  coincide  with  prevailing  manager  and  worker  attitudes 
in  the  same  company.  Table  2  shows  the  parallel  first-order  relations 
between  financial  data  and  personnel  attributes  of  each  of  the  companies. 

We  next  moved  from  this  empirical  level  to  an  examination  of  some 
logically  derived  variables. 

Derived  Index  Level 


Costs  such  as  for  raw  materials  obviously  depended  heavily  on 
gross  sales  effectiveness.  (The  correlation  was  .84  between  sales  and 
raw  materials  costs  for  the  28  companies,  for  instance.) 
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Therefore,  indices  were  derived  logically  to  examine  the  relative 
costs  per  sale  by  the  companies  to  see  the  costs  of  operation  in  the 
different  companies  with  sales  held  constant.  Profit  indices  were  also 
figured  here.  These  derived  indices  were  then  correlated  with  attitudinal 
information  from  managers  and  workers  and  with  personnel  attributes  of 
the  companies. 

Eight  cost-effectiveness  indices  were  calculated: 

1.  Salary  and  Wag^.3  Costs  Per  Sales  Income 

2.  Inventory  Costs  Per  Sales  Income 

3.  Advertising  Costs  Per  Sales  Income 

h.  Raw  Materials  Purchases  From  or  Sales  of  Finished  Goods  to 
Other  Companies  Rather  Than  Direct  to  Market  Per  Total  Sales 
Income 

5.  Cost  of  Materials  Used  Per  Sales  Income 

6.  Returns  to  Investors,  Bonuses  and  Salaries  and  Wages  Paid 
Out  Per  Net  Worth  (Aggregate  Wealth  Produced  in  Proportion 
to  Original  Investment) 

7.  Total  Expenditures 

8.  Operating  Profit  (Before  Taxes) 

The  correlations  between  attitudes  and  the  derived  indices  are 
displayed  in  Tables  3  and  h. 

Factor  Level 


This  more  abstract  level  of  analysis  was  achieved  by  factor  anal¬ 
yses  of  the  matrices  of  raw  intercorrelations  among  the  financial,  atti¬ 
tudinal  and  personnel  variables.  A  factor  analysis  was  completed  for  the 
financial  variables  alone,  and  another  was  completed  for  each  of  the 
managerial  and  worker  panels  of  attitudinal  variables  for  the  28  compa¬ 
nies.  Conqaany  policy  was  also  interrelated  with  the  variables.  Half  of 
the  companies  pursued  a  policy  of  "top-down"  management  with  greatest 
attention  on  the  external  environment,  centralized  and  individualized 
decision-making  at  the  highest  possible  levels.  The  other  companies 
pursued  a  reverse  policy  of  greatest  attention  to  internal  affairs,  de¬ 
centralized  and  group  decision-making  at  the  lowest  possible  levels. 

Each  factor  analysis  provided  a  minimum  number  of  orthogonal  di¬ 
mensions  to  account  for  the  common  variance  among  the  variables  in  the 


matrix  bo  analyzed.^  Instead  of  logically  clustering  the  many  variables 
ve  could  measure,  ve  empirically  clustered  into  indices  those  variables 
high  in  correlation  with  each  other  and  low  in  correlation  with  the 
variables  of  other  clusters.  From  this  ve  could  see  hov  company  policy 
related  to  performance  on  the  abstract  clusters  of  variables. 


Results 


Rav  Data  Level  of  Analysis 


We  will  first  look  at  hov  attitudes  related  to  financial  and 
material  data,  then  hov  mean  intelligence,  age,  orientation  and  so  on 
vere  associated  vith  monetary  and  material  performance. 

Attitudes  Versus  Financial  Outcomes. 


The  first-order  correlations  among  the  rav  variables  of  Table  1 
gives  us  an  empirical  description  of  financial  positions  of  the  28 
companies  vhich  tended  to  match  pie  vailing  attitudes  among  managers 
and  vorkero  within  the  same  companies. 5 

Satisfaction  vith  one's  particular  job  in  the  company  did  not  seem 
particularly  related  to  any  significant  degree  vith  the  financial  per¬ 
formance  of  the  company.  On  the  other  hand,  satisfaction  vith  the  company 
operations  (among  both  managers  and  workers)  was  greater  in  those 
companies  who  shoved  heavy  use  of  rav  materials  (.47,  .55)  and  large 
sales  volumes  (.51,  .57)*  As  might  be  expected,  workers'  satisfaction 
vith  company  operations  was  heightened  by  higher  salaries  and  wage  pay¬ 
ments  (.43), 

Management  satisfaction  with  subordinates  was  higher  when  gross 
sales  vere  high  (.62)  and  the  necessary  rav  materials  costs  (.56^ 
associated  vith  such  sales  were  also  high. 

Both  managers  and  workers  saw  much  overlapping  of  responsible . 1 f  c* 
vhen  gross  sales  were  low  (-.63,  -.53)  and  less  materials  were  vjco 
(-.66,  -.65).  At  the  same  time,  companies  vhich  failed  to  .jenerat  . 
market  demand  through  large  expenditures  for  market  research  and  c 
vertising  vere  likely  to  be  seen  by  both  their  workers  and  man-v-i.. 
as  companies  vith  much  overlapping  of  responsibilities  (-.47,  -.35, 

-.37,  -.49). 

Ease  in  selling  ideas  had  important  association  w •*  .  0  n 

(.48),  rav  materials  used  (.43)  and  low  advertising  cost  •'*  .j8)  for 
managers  but  not  for  vorkero.  Yet,  the  ea  \?  with  vuieh  B.inag  to  r  wort  ov 
felt  they  could  be  open  in  criticism  of  the  orsunizatlor  1  unr;- 
lated  to  financial  performance. 


Worker  satisfaction  with  boss  seemed  to  be  coupled  with  the 
readiness  of  the  company  to  use  large  amounts  of  raw  materials  (.47), 
while  managers  seemed  to  be  more  pleased  with  their  boss  when  ad¬ 
vertising  costs  were  high  (.40)  and  only  regular  purchasing  channels 
were  used  (-.40). 

Clear  lob  goals  for  both  managers  and  workers  were  associated 
with  sales  (>33,  .48)  and  raw  materials  used  (.47*  .50) ,  hut  the 
opportunity  to  make  one's  own  decision  and  to  perceive  that  one's 
authority  matched  one's  responsibility  was  unrelated  generally  to 
financial  performance. 

While  upward  communication  failure  was  associated  by  both  managers 
and  workers  with  low  sales  income  (-.35*  -.42)  and  low  materials  usage 
(-.45,  -.34),  workers  tended  to  see  much  greater  upward  comnunication 
failure  when  expenditures  for  equipment  was  kept  low  (-.59) •  Workers 
also  perceived  much  more  conflict  of  interest  when  equipment  vas  not 
rented  or  purchased  in  large  amounts  (-.62).  Cto  the  ot>.  _•  hand,  manage¬ 
ment  perceived  conflicts  of  interest  to  be  high  when  gross  sales  acti¬ 
vity  was  low  (-.53),  coinciding  consequentially  also  with  the  lack  of 
expenditures  to  cover  such  sales  including  expenditures  for  raw  mate¬ 
rials  (-.55),  for  market  research  (-.4l)  and  for  advertising  (->45). 
Managers  saw  individual  decision-making  coinciding  with  low  expenditures 
for  equipment  (-.64),  while  workers  saw  individual  decision-making 
appearing  in  companies  when  gross  sales  were  high  (.37)  along  with  ex¬ 
penditures  for  advertising  ( .71). 

Of  the  nine  raw  financial  items  examined,  only  interest  charges 
failed  to  be  associated  significantly  with  some  mean  management  and/or 
worker  attitude  tovaxds  the  company  or  some  aspect  of  work. 

Personnel  Attributes. 

Inspection  of  Table  2  reveals  that  the  mean  verbal  aptitude  of 
both  ranagers  and  workers  was  strongly  associated  with  the  various 
financial  outcomes.  When  the  verbal  aptitude  of  the  average  manager 
was  high  so  were  the  company's  grosB  Bales  (.48),  raw  materials  used 
(.45),  market  research  costs  (.68),  advertising  costs  (.47),  and 
interest  charges  (.59) •  But  as  was  subsequently  discovered,  those 
companies  whose  managers  were  high  in  verbal  aptitude  were  also  likely 
(.47)  to  contain  workers  similarly  high  on  the  average  in  verbal  apti¬ 
tude.  Consequently,  the  mean  verbal  aptitude  of  workers  also  correlated 
positively  with  most  of  the  same  financial  outcomes.  When  the  mean  ver¬ 
bal  aptitude  of  workers  was  high,  so  was  gross  sales  (.52).  raw  materials 
used  (.59),  salaries  and  wages  (.51),  storage  charges  (.42;,  market  re¬ 
search  (.47)  and  interest  charges  (.63).  (The  management -worker  correla¬ 
tional  differentials  here  tempt  one  to  speculate  that  high  managerial 
verbal  aptitude  particularly  increased  willingness  of  management  to 
spend  money  on  market  research  and  advertising,  while  high  verbal  apti¬ 
tude  among  workers  increased  the  required  wage  and  salary  payments 
within  the  company  as  well  as  expenditures  for  inventory.) 
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On  the  other  hand,  the  mean  quantitative  aptitude  of  managers  wrb 
unrelated  to  financial  outcomes,  although  the  quantitative  aptitude  of 
vorkers  correlated  with  gross  sales  (.46),  raw  materials  used  (.46), 
salaries  and  wages  (.47),  and  advertising  costs  (.hi).  Older  workers, 
in  particular,  tended  to  push  up  raw  materials  usage  (.53),  storage 
charges  (.49),  and  interest  charges  (.37). 

The  mean  orientation  of  managers  and  workers  seemed  unrelated 
generally  to  financial  outcomes  tc  any  significant  degree  although 
high  self -orientation  among  vorkers  coincided  with  high  storage  costs 
(.53).  More  strongly  pro-union  attitudes  among  workers  led  to  higher 
sales  (.48),  higher  salaries  and  wages  (.42),  higher  equipment  costs 
(.37)  and  higher  storage  charges  (.56).  More  liberal  union  attitudes 
among  managers  tended  to  coincide  with  low  storage  charges  (..49), 
but  higher  market  research  (.76)  and  advertising  (.52)  expenditure . 
When  the  mean  amount  of  managerial  experience  was  high,  so  was  raw 
material  usage  (.51)  and  interest  charges  (.37)  while  the  amount  of 
worker  experience  correlated  .42  with  rav  material  usage  and  .57  with 
storage  charges. 

Derived  Index  Level  of  Analysis 


We  can  obtain  an  increased  clarification  of  the  meaningfulness 
of  the  first-order  relationships  observed  in  Tables  1  and  2  by  turning 
to  the  more  complex  associations  uncovered  when  the  eight  derived 
indices  were  correlated  with  personnel  attitudes  and  attributes. 

Attitudes  versus  Indices. 

As  seen  in  Table  3,  none  of  the  attitudlnal  variables  correlated 
significantly  different  from  zero  with  the  first  index,  wage  cost  per 
sales  income.  Materials  used  per  sales  income  also  seemed  to  be  in¬ 
dependent  of  attitudlnal  data  except  for  the  significant  correlation 
of  .43  with  the  extent  workers  saw  themselves  in  a  conflict  of  in¬ 
terest  and  a  negative  correlation  of  -.59  with  the  extent  to  which  they 
saw  that  decisions  were  made  by  individuals  rather  than  by  groups  in  the 
conpany.  Thus,  workers  saw  more  conflict  and  more  decision  by  groups 
rather  than  individuals  in  those  companies  which  tended  to  use  an  un¬ 
necessary  amount  of  materials  in  production  for  a  given  amount  of  sales. 
But  management  attitudes  were  unrelated  to  this  particular  index. 

Generally,  companies  with  high  inventory  costs  per  sales  income 
were  seen  unfavorably  by  both  company  management  and  company  workers. 

If  inventory  costs  were  excessive,  satisfaction  with  company  opera¬ 
tions  was  low  both  among  managers  and  workers  (-.62  and  -.56).  There 
also  was  greater  dissatisfaction  with  subordinates  (-.56  and  -.46). 
Furthermore,  workers  saw  themselves  with  less  clear  Job  goals  (-.58) 
while  management  saw  much  communication  failure  upward  (.58),  over¬ 
lapping  responsibilities  (.46)  and  lack  of  ease  in  selling  ideas  (.46) 
when  inventory  coats  per  sales  income  were  high  in  companies . 
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Unfavorable  management  (but  not  -worker)  attitudes  towards  the 
company  and  its  operations  tended  to  be  associated  with  the  extent  to 
which  the  company  was  forced  to  buy  and  sell  raw  materials  and  finished 
goods  to  its  competitors  rather  than  carrying  on  all  of  its  business 
in  the  regular  channels  of  conmerce.  Presumably ,  the  company  that 
planned  its  production  satisfactorily  would  have  little  need  to  turn 
to  its  competitors  for  assisuance.  While  this  activity  outside  the 
regular  marketing  and  purchasing  channels  was  unassociated  with  worker 
attitudes.  Table  3  shows  that  where  such  outside-of-regi  r-marketing 
activity  was  relatively  high  in  contrast  to  the  total  sales  volume  for 
a  company,  the  company  management  was  likely  to  be  unclear  about  its 
job  goals  (-.59)*  dissatisfied  with  its  subordinates  (-.49),  feel  that 
it  was  not  easy  to  sell  one's  ideas  to  others  in  the  organization 
(-.47),  see  a  great  deal  of  upward  comnunication  failures  ( . 3I) ,  see 
little  opportunity  to  make  one's  own  decisions  (-.1*3)  and  be  dissatis¬ 
fied  with  one's  boss  (-,l+o). 

The  financial  index  which  seemed  to  covary  most  closely  with  both 
management  and  worker  attitudes  was  advertising  coBts  per  sales  income. 
Here  again,  an  excess  of  advertising  per  sales  dollar  might  come  about 
not  necessarily  as  a  function  of  lack  of  advertising  quality,  but  as 
a  consequence  of  the  failure  of  the  conpany  to  produce  the  quality  and 
quantity  of  products  generating  the  sales  income  possible  as  a  conse¬ 
quence  of  the  amount  of  money  spent  on  advertising.  When  advertising 
costs  per  sales  income  were  excessive,  management  was  highly  dissatis¬ 
fied  with  company  operations  (-.74)  and  with  its  subordinates  (-.55). 
Management  also  saw  much  upward  communication  failure  (.63)  and  a 
great  deal  of  overlapping  of  responsibilities  (,4l).  At  the  same  time, 
excessive  advertising  costs  were  likewise  associated  with  worker  dis¬ 
satisfaction  with  company  operations  (-.71)  and  confusion  about  job 
goals  (-.71).  The  average  worker  also  saw  a  high  degree  of  conflict  of 
interests  and  much  upward  comnunication  failure  (.53  and  .52)  when  ad¬ 
vertising  costs  were  excessive.  But  opposite  to  the  association  with 
excessive  materials  usage,  here  workers  were  more  likely  to  associate 
individual  rather  than  group  decision-making  with  excessive  advertising 
costs. 

Returns  to  investors,  managers  and  employes,  in  the  aggregate, 
were  also  reflected  (positively,  of  course)  in  both  management  and  wor¬ 
ker  attitudes  toward  the  company.  Both  managers  and  workers  felt  more 
satisfied  with  company  operations  when  returns  were  high  (.55  and  .62). 
They  saw  little  overlapping  of  responsibilities  (-.58  and  -.49).  More¬ 
over,  managers  were  more  satisfied  with  their  subordinates  (.60)  and 
with  the  ease  in  selling  ideas  (.39)  in  those  companies  whose  returns 
and  conpensations  were  high.  They  also  saw  less  upward  communication 
failures  and  less  conflict  of  interests  (-.43  and  -.43).  At  the  same 
time,  workers  were  more  likely  to  have  clear  Job  goals  (.48)  and  be 
more  satisfied  with  their  boss  (.43).  For  managers  but  not  workers, 
high  gross  returns  on  investment  were  more  comnon  when  decisions  were 
seen  as  made  by  individuals  (.40). 
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Cost-Effectiveness  versus  Personnel  Attributes 


As  can  be  seen  in  Table  4,  high  wage  costs  per  sales  dollar  were 
rare  likely  when  workers  were  higher  in  overall  verbal  and  quantitative 
aptitude  ( ,4l) .  In  turn,  intelligent  workers  pushed  up  total  company 
expenditures  (.56);  thus,  although  total  wealth  produced  was  higher, 
operating  profits  were  not  when  the  average  worker  was  high  in  apti¬ 
tude.  Total  expenditures  were  also  greater  when  the  average  manager  was 
higher  in  intelligence  (.51)*  Cm  the  other  hand,  older  managers  were 
less  likely  to  go  outside  regular  market  channels  relative  to  their 
total  sales  income  of  their  companies  (-.39)*  The  same  was  true  if  wor¬ 
kers  were  older  (-.37)*  While  attitude  toward  unions  by  managers  was 
unrelated  to  cost-effectiveness  indices,  pro-union  proclivities  on 
the  part  of  the  workers  were  associated  with  low  advertising  costs  per 
sales  income  (-.43),  low  material  usage  per  sales  income  (-.64), 
greater  returns  on  investment  (.47)  despite  the  larger  amount  of  total 
expend! tures  (.49).  Experienced  managers  had  lover  advertising  budgets 
relative  to  their  sales  income  (-.37)  whale  companies  with  experienced 
workers  had  greater  gross  returns  on  investment  and  compensation  to 
managers  and  workers  (.38)*  Orientation  of  ranagere  and  workers  was 
unrelated  to  any  significant  degree  with  any  of  the  financial  cost- 
effectiveness  indices. 

In  sum,  wage  and  material  costs  per  sale  do  not  reflect  manage¬ 
ment  and  worker  satisfaction  as  well  as  do  inventory  and  advertising 
costs  per  sales  dollar.  Managers  seem  particularly  dissatisfied  in 
firms  with  much  extra  market  activity.  More  able,  liberal  and  ex¬ 
perienced  workers  are  found  in  firms  yielding  greater  overall  output, 
but  they  obtain  higher  wages  so  that  higher  profits  do  not  follow. 
Verbally  apt  and  liberal  managers  seem  willing  to  spend  more  money 
likewise  inhibiting  any  enhancement  of  profits. 

Abstract  Level  of  Factor  Analysis 

This  more  abstract  level  of  analysis  was  reached  by  means  of 
factor  analysis  of  each  of  the  panels  of  financial  and  ettitudlnal 
variables  searching  within  each  panel  for  a  minimum  number  of  di¬ 
mensions  to  account  for  the  common  variance  among  companies  in  their 
fiscal  and  morale  standings.  Table  5  displays  the  correlations  among 
the  raw  financial  variables.  Table  6  shows  the  four  orthogonal,  rotated 
factors  which  alone  could  account  for  approximately  85  percent  of 
the  common  variance  of  Table  5  among  the  financial  "variables  and  the 
company  policy.  It  also  shows  the  factor  loadings  or  the  correlations 
between  variables  and  factors. 

The  first  factor,  FI,  was  identified  as  Gross  Processing  Activity. 
Companies  higb  on  this  factor  had  heavy  sales  to  market  (.y?T#  asso- 
ciated  heavy  advertising  costs  (.87),  market  research  (.72)  and  raw 
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materials  usage  ( «8o) .  Such  companies  also  paid  out  higher  salaries 
and  wages  (.56)  and  borrowed  more  money  requiring  greater  interest 
charges  (.%))*  "top-down"  policies  coincided  with  higher  activity 
(.54). 

Factor  F2  was  composed  of  such  Variable  Costs  as  wages  (.7*0* 
storage  ( .7*0  and  off -market  purchases  of  raw  materials  or  finished 
goods  from  competitors  to  meet  market  quotas  (.72). 

Factor  F3  was  seen  as  Involving  Conservative  Planning, for 
companies  high  on  this  factor  borrowed  less  money,  thus  had  less 
interest  costs  (-.65),  but  produced  more  goods  than  they  advertised 
or  priced  for  in  the  market  so  had  to  sell  to  competitors.  They  pro¬ 
bably  underestimated  their  productive  capacities  and  did  not  keep  as 
well  abreast  of  market  conditions  as  their  competitors.  In  line  with 
the  usual  findings  about  the  greater  riskiness  of  decisions  made  by 
groups,  the  individualized  "top-down"  policies  were  associated  with 
conservative  planning  (.48). 

Factor  F4  was  heavily  loaded  on  equipment  costs.  Companies  with 
such  heavy  capital  investments  or  leasing  commitments  tended  to  do 
more  market  research  (.45)  and  possibly  needed  to  turn  to  competitors 
on  occasion  for  raw  materials  to  purchase  (.35). 

Looking  at  the  individual  variables,  one  could  see  that  sales  to 
market,  sales  to  other  companies,  equipment  and  advertising  costs  were 
"pure"  measures  each  loaded  on  only  a  single  factor.  On  the  other  hand, 
the  other  variables  were  more  conqxLex  factorially.  Raw  material  usage 
was  high  when  gross  processing  activity  was  up  as  well  as  in  companies 
with  higher  variable  costs.  The  same  was  true  (although  the  proportions 
were  different)  for  salaries  and  wages.  High  storage  costs  coincided 
with  high  variable  costs  in  general  as  well  as  liberal  planning.  Mar¬ 
ket  research  loaded  on  two  or  three  of  the  factors  as  did  interest 
charges.  "Top-down"  policies  coincided  with  greater  processing  activi¬ 
ty  and  with  conservative  planning. 

Attitudlnal  Factors.  The  matrix  of  intercorrelations  among  the  15 
managerial  variables  (not  shown)  was  factor  analyzed  as  was  the  matrix 
of  worker  variables”.  Table  7  shows  the  varimax  solution  achieved  for 
the  managerial  variables  accounting  for  74  percent  of  the  common  vari¬ 
ance  of  the  intercorrelation  matrix.  Table  8  shows  the  solution 
achieved  for  the  worker  variables  accounting  for  8l  percent  of  the 
c oilman  variance. 

The  four  managerial  dimensions  extracted  and  the  variables  with 
highest  loadings  (signs  reversed  where  necessary)  were: 
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Ml  Satisfaction  with.  Top  Management  and  Policies 


.85  Top-Down  Policies 

.72  Satisfaction  with  Boss 

•55  (Lack  of)  Conflict  of  Interest 

.46  Clarity  of  Job  Goals 

Although  Individual  responsibility  and  internal  responsivity 
were  stated  company  policies,  such  responsibility  and  responsivity 
were  not  perceived  by  managers  as  associated  with  company  policy. 

They  contributed  to  variance  on  other  factors,  however. 

Mg  Satisfaction  with  Individual  Responsibility  and  Authority 

.90  Felt  Opportunity  for  Own  Decisions 

.86  Felt  Matching  of  Authority  and  Responsibility 

.65  Group,  Rot  Individual  Decisions 

•  54  (Lack  of)  Upward  Conaunlcation  Failures 

M3  Internally  Responsive  Company 

.85  Perceived  Internally  Responsive  Company 

.51  (Lack  of)  Overlapping  Responsibilities 

.49  Individual,  Rot  Group  Decisions 

.45  (Lack  of)  Conflict  of  Interests 

M4  Satisfaction  with  Climate  and  Operations 

.89  Satisfaction  with  Company  Operations 

.85  Satisfaction  with  Subordinates 

.75  Base  in  Selling  Ideas 

.71  Ebb-  in  Openness 

.69  Job  Satisfaction 

.66  Clarity  of  Job  Goals 

.60  (Lack  of)  Upward  Communication  Failures 

.^8  (lack  of)  Overlapping  Responsibilities 

Five  factors  were  extracted  from  the  mean  responses  of  the  workers 
to  the  questionnaires  in  the  28  companies.  For  workers,  salient  factors 
clustered  around  freedom  from  conflict  (Wl),  permissive  supervision 
(W2),  satisfaction  with  working  conditions, and  as  with  managers,  satis¬ 
faction  with  responsibility  and  authority  (W5);  but  where  the  "top- 
down"  policy  was  associated,  in.  a  single  factor  with  various  aspects  of 
managerial  satisfaction  (Ml),  the  "top-down"  policies  in  companies 
generated  no  such  associated  high  satisfaction  among  workers  whose  only 
consistent  perception  was  of  much  Individual  decision-making  when  opera¬ 
ting  under  such  stated  policies. 
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Other  Analysis  Possible 

We  could  proceed  to  obtain  factor  scores^  for  companies  in  each 
factor  to  profile  coupenies  on  these  abstract  orthogonal  dimensions. 
Or,  we  could  correlate  these  scores  across  different  panels  to  look 
somewhat  more  abstractly  at  the  relations  examined  in  the  first  four 
tables.  However,  such  extensions  are  simply  further  exercises  in  the 
use  of  factor  analysis  and  need  not  be  pursued  here. 

Source  of  Data 


Although  the  sources  of  the  data  are  Irrelevant  to  the  methodo¬ 
logical  purposes  of  this  paper,  it  may  come  as  somewhat  of  a  disappoint¬ 
ment  to  learn  of  the  sources  of  the  data  analyzed.  Unfortunately, 
coanpatd.es  are  not  inclined  to  collect  or  publish  such  non  -  financ  i&l 
data  as  we  examined  here--  although  such  data  may  be  available  or  re¬ 
quested  by  outside  auditors. 

The  sources  of  the  data  were  28  "companies"  each  containing  l6 
graduate  business  students,  half  of  idiom  served  as  managers  and  half 
as  workers.  The  companies  existed  for  four  hours  of  production  and 
competitive  marketing,  during  which  time  the  eight  managers  of  each 
company  purchased,  planned,  advertised,  priced  and  sold  five  kinds  of 
"I-beams"  literally  produced  from  cut-assembled-and-stapled  IBM  cards 
by  the  eight  workers  of  each  company.  Real  work  was  done  by  all;  only 
the  money  was  funny.  The  communication  problems  of  the  large  organiza¬ 
tion  were  simulated  by  enforcing  a  rule  that.no  more  than  five  members 
of  the  company  could  ever  meet  face-to-face.  Nevertheless,  the  kinds 
of  data  examined  here  are  identical  to  what  can  be  analyzed  in  real 
companies,  a  gencies  or  departments  if  it  is  possible  to  collect  data. 
More  extraneous  variance  is  likely  to  appear  in  matrices  of  data  from 
real  life,  but  this  is  one  more  reason  for  suggesting  the  utility  of 
multivariate  analyses,  such  as  presented,  to  tease  out  the  interplay 
among  financial,  material  and  human  variables  affecting  the  systems 
under  study. 
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Footnotes 


■^Supported  by  the  Office  of  Haval  Research,  Group  Psychology  Branch, 
this  report  vas  prepared  for  the  Proceedings  of  the  Logistics  Re¬ 
search  Conference,  Department  of  Defense,  Warrenton,  Viriginia, 

May  26,  27,  28,  1965.  Reproduction  in  whole  or  in  part  is  permitted 
for  any  purpose  of  the  United  States  Government. 

%bus,  sales  and  profits  are  artifactually  related  if  profits  are 
equal  to  sales  less  expenses*  We  correlate  here  two  expressions, 
both  of  which  contain  or  are  entirely  made  up  of  the  same  variable. 

3These  factors  were  extracted  by  the  method  of  principal  components. 

In  essence,  a  plotting  of  coaqmny  standings  on  the  10  financial 
variables  formed  a  hyperellinsold  of  10  dimensions.  Factor  analysis 
determined  the  relative  lengths  of  its  10  axes.  Little  unexplained 
comnon  variance  was  left  after  the  first  four  longest  axes  had  been 
noted;  the  other  six  were  discarded.  To  simplify  the  structure,  the 
four -dimensional  ellipsoid  was  now  rotated  to  achieve  a  varlmax 
solution,  a  solution  in  which  the  variance  is  nr.im  of  the  factor 
loadings*  This  maximum  solution  distributes  the  variance  each  variable 
had  in  comnon  with  the  other  variables  (its  comnuaality)  so  that  the 
variable  correlates  as  high  as  possible  with  as  few  factors  as  possible 
and  as  low  as  possible  with  all  other  factors.  The  factors  are  identi¬ 
fied  by  the  variables  which  alone  or  in  combination  correlate  with 
the  factors. 


^Combining  variables  by  factor  analysis  rather  than  combining  them 
logical:  j  into  indices  helps  to  avoid  the  possibilities  of  misinter¬ 
preting  the  behavior  producing  the  high  or  low  index  numbers .  For  in¬ 
stance,  a  materials  cost/sales  ratio  could  be  low  primarily  because 
of  lower-than-ordinary  materials  usage  in  production.  Or  it  could  be 
low  because  of  higher-than -ordinary  sales  volume.  Furthermore,  sales 
volume  could  be  high  (lowering  the  ratio)  as  a  consequence  of  the  high 
production  of  underpriced  goods  or  the  low  production  of  overpriced 
merchandise.  At  the  same  time,  more  materials  would  need  to  be  used 
for  the  higher  production  of  underpriced  items  raising  the  ratio.  Given 
the  right  variables,  factor  analysis  could  help  sort  out  companies 
according  to  their  relative  performance  on  whichever  dimensions  really 
underlay  the  fira-to-firm  variations  in  materials  usage,  sales  volume, 
pricing  and  production. 


^For  the  28  companies,  a  product -moment  correlation  of  .U7  would  occur 
only  once  in  a  hundred  times  by  chance.  A  correlation  of  .37  would 
occur  about  five  times  in  a  hundred  by  chance. 


^Included  in  these  analyses  were  mean  responses  to  the  13  attitudinal 
questions,  whether  or  not  the  company  had  &  "top-down"  policy  and  the 
mean  response  to  a  question  as  to  whether  the  company  was  primarily 
reaponsiTe  to  the  needs  of  its  own  members  or  to  the  external  environ¬ 
ment. 


15^ 


7to  find  a  company  high  in  standing  on  a  factor,  we  sum  the  products  of 
the  company's  standard  scores  on  each  of  the  original  variables  multi¬ 
plied  by  their  respective  factor  loadings.  The  factor  loadings  are 
the  partial  regression  coefficients  on  the  factor  of  each  of  the  vari¬ 
ables  since  the  factors  are  orthogonal  so  that  the  multiple  correlation 
between  a  Factor  F  and  variables  V  loaded  on  it  becomes: 


R2 

2  .  2 

■  + 

and  a  company's  factor 

XEV  FV2  **** 

FV 

3 

f  = 

r  X  .  +  r 

...  +  r  X 

where  X  is  the  stan- 

FV  1  FV2  2 

FV  j 

dard  score  of  the  company  on  a  given  variable. 

®For  details  of  UPFOE,  the  University  of  Pittsburgh  Production  Organi¬ 
zation  Exercise,  see  Bass  (1964). 
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MEAN  ATTITUDES  OF  MANAGER  AND  WORKERS  RELATH)  TO 
THE  YEAR-END  FINANCIAL  REPORT  OF  20  UPFOE  COMPANIES 
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TABLE  5 

INTERCORRELATIONS  AMONG  THE  10  FINANCIAL 
VARIABLES  AND  COMPANY  POLICY 
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ABSTRACT 


COMMITTEE  DECISIONS* 
Dr.  Gordon  Tullock 


Committee  activities  enter  into  many  Governmental  decisions,  in¬ 
cluding  decisions  related  to  co3t/effectivenese.  Although  committees 
may  be  formed  or  activated  for  reasons  other  than  reaching  decisions, 
the  following  remarks  are  directed  only  (or  in  the  main)  to  the  latter 
class  of  cases.  They  are  intended  to  summarize  certain  salient  problems 
that  have  entered  into  research  which  the  author  now  has  under  way  in 
this  area. 

Recent  work  in  application  of  economic  models  to  political  problems 
has  dealt  with  collective  decision  procedures,  but  all  of  the  existing 
models  require  that  the  group  reach  its  decision  by  some  formal  voting 
procedure.  They  are  not,  therefore,  directly  applicable  to  the  normal 
committee.  One  aspect  of  this  theory,  however,  can  be  carried  over: 
Individual  members  of  decision  groups  aim  at  their  own  ends,  which 
are  not  necessarily  those  given  to  the  committee  itself  in  the  organi¬ 
zation  chart.  Commonly  in  committees  the  individual  member  is  primarily 
motivated  by  a  desire  to  improve  his  status  in  the  permanent  organiza¬ 
tion  which  he  represents  in  the  committee.  His  role,  and  his  behavior, 
is  that  of  an  ambassador  attempting  to  get  as  much  as  possible  for  his 
principle.  A  second  motivation  may  be  a  desire  to  sell  something  which 
the  individual  committee  member  values.  Finally,  the  individual  may, 
indeed,  have  internalized  the  ostensible  objectives  of  the  committee, 
and  thus  simply  make  decisions  in  terms  of  how  well  they  fit  that  ob¬ 
jective.  This  type  of  behavior  I  term  judicial,  and  I  think  that  it 
is  rare  without  the  very  special  precautions  with  which  the  constitution 
surrounds  federal  judges. 

Committees  can  be  classified  largely  by  the  type  of  motivation  which 
dominates  their  members.  Firstly,  however,  some  organizations  which  look 
much  like  committees,  but  which  really  make  no  decisions  must  be  elimina¬ 
ted.  These  organizations,  and  the  conference  of  a  learned  society  may  be 
taken  as  the  type  case,  exist  for  the  exchange  of  Information,  not  to 
plan  action.  Many  ostensible  coraaittees  actually  are  organizations  to 
improve  coordination  by  providing  channels  for  Information  transfer 
rather  than  making  decisions.  Another  committee -like  organization  is 
the  entity  which  used  to  go  under  the  name  of  "royal  council."  Any 
individual  decision  maker  is  likely  to  want  advice  and  specialized 
counsel.  An  organization  for  giving  such  advice,  the  cabinet  will  do 
as  an  example,  may  easily  be  mistaken  for  a  committee.  The  difference 
Is  that  the  president,  not  the  cabinet,  makes  the  decisions. 


*  This  paper  is  not  published  in  its  entirety  in  this  volume. 
Requests  for  further  information  should  be  addressed  to  the  author. 
Dr.  Gordon  Tullock,  Department  of  Economics,  University  of  Virginia, 
Charlottesville,  Va. 
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Most  actual  committees  in  the  executive  area  are  composed  of 
people  who  act  like  ambassadors  representing  different  organizations, 
and  the  connittee  Itself  functions  much  like  a  diplomatic  conference. 
There  is  the  same  tendency  to  delay  and  seeking  of  the  lowest  comon 
denominator.  There  are  some  intra-organization  eosmittees,  however, 
and  these  do  not,  at  least,  have  the  strong  conflicting  interests 
which  dominate  the  inter-organization  committees.  The  appellate  courts 
are  the  heat  examples  of  committees  in  vhlch  the  members  do  not 
function  as  representatives  of  other  organizations. 

Probably  the  most  predictable  consequence  of  referring  some  decision  to 
a  committee  is  delay.  It  la  also  likely  to  lead  to  the  eventual  decision 
(if  there  Is  a  decision)  being  a  compromise.  Sometimes  the  compromise 
will  be  merely  verbal,  a  formula  which  permits  different  interpreta¬ 
tions,  but  it  may  be  genuine.  If  the  people  on  the  connittee  represent 
Interests  which  are  thought  to  have  a  legal  or  moral  right  to  be  con¬ 
ciliated,  then  the  compromise  may  be  the  ideal  outcome.  This  is,  of 
course,  the  reason  for  the  use  of  large  committees,  called  legislatures. 
In  most  democratic  governments. 

Hie  normal  outcome  of  the  use  of  comdtteea  to  make  administrative 
decisions  is  a  reduction  of  individual  responsibility  for  the  decision, 
and  a  reduction  In  the  quality  of  the  decision  making  personnel.  Hie 
last  Is  a  consequence  of  the  fact  that  the  money  used  to  hire  5  connittee 
members  at  $20,000  apiece  could  hire  one  man  at  $100,000  or  a  man  at 
$40,000  with  three  advisors  at  $20,000.  In  either  case  (assuming  that 
it  Is  possible  to  Judge  ability)  the  actual  decision  maker  would  be 
of  a  higher  level  of  capacity  than  anyone  on  the  original  connittee. 

It  is,  I  suppose,  clear  from  my  book.  The  Politics  of  Bureaucracy, 
that  I  think  that  the  executive  branch  of  the  federal  govemmentls  an 
appalling  administrative  mess.  The  widespread  use  of  conmittees  for 
decision  making  Is  both  evidence  and  the  result  of  this  maladministra¬ 
tion. 


